00000001:02000400:0.0F:1786960559.512606:0:2959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_hostid 00000001:02000400:0.0:1786960568.470985:0:3161:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1786960569.328414:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1287 MB/s 00000001:01000000:0.0:1786960569.578537:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1695 MB/s 00000001:01000000:2.0F:1786960569.828289:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8419 MB/s 00000020:02000000:2.0:1786960570.418137:0:3253:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_50_g3eb67fe 00000400:02000000:0.0:1786960571.699717:0:3268:0:(api-ni.c:2822:lnet_startup_lndni()) Added LNI 192.168.203.123@tcp [8/256/0/180] 00008000:02000000:0.0:1786960575.391802:0:3418:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1786960618.979884:0:5217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1786960626.841392:0:5791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786960626.841532:0:5791:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1786960626.841668:0:5791:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000009505c1b8 00000080:02000400:3.0:1786960626.841678:0:5791:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1786960626.849582:0:5791:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1786960626.849596:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786960626.849635:0:5791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003579515c) 00000020:00000080:3.0:1786960626.849655:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786960626.865846:0:5791:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1786960626.866262:0:5791:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1786960626.881969:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1786960626.882005:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786960626.882024:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1786960626.882070:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786960626.882090:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1786960626.882472:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786960626.882480:0:5791:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786960626.882490:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f1cc 00000020:01000004:2.0:1786960626.882497:0:5791:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1786960626.882503:0:5791:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786960626.882508:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009505c1b8 from MGS 00000020:01000004:2.0:1786960626.882513:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786960626.882531:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000631151c1) 00000020:00000080:2.0:1786960626.882543:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786960626.882602:0:5791:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009505c1b8 from MGS, refs=2 00080000:01000000:2.0:1786960626.882608:0:5791:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786960626.882613:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f1da 00000100:00100000:2.0:1786960626.882704:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786960626.882817:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786960626.882823:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786960626.883487:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786960626.883502:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786960626.884313:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960626.884480:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786960626.884486:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1786960626.884990:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1786960626.884997:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786960626.885391:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786960626.885397:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1786960626.886007:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960626.886011:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960626.886012:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960626.886356:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960626.886358:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960626.886360:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960626.886824:0:5791:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1786960626.894402:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1786960627.136326:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3675 MB/s 00000001:01000000:3.0:1786960627.386420:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3087 MB/s 00000001:01000000:2.0:1786960627.637052:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 647 MB/s 00000001:01000000:2.0:1786960627.886727:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 795 MB/s 00010000:00010000:0.0:1786960627.892807:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0F:1786960627.898291:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1786960627.937679:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1786960627.937695:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786960627.937697:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1786960627.948951:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786960627.949284:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786960627.949353:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1786960627.949612:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1786960627.949639:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786960627.949952:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786960627.950103:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786960627.950110:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1786960627.953707:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1786960627.953722:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1786960627.954741:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1786960627.954751:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1786960627.955387:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1786960627.955407:0:5791:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:1.0:1786960627.955409:0:5791:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1786960627.955448:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:1.0:1786960627.955466:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (000000004aa9d72b) 00000020:00000080:1.0:1786960627.955483:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1786960627.955714:0:5791:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c56fdbcc@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1786960627.955866:0:5791:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:1.0:1786960627.955873:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 00000100:00080000:3.0:1786960627.958034:0:5806:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1786960627.968409:0:5807:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1786960627.969690:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid c3f21e71-ba64-41c6-8589-43a20e36767f) 00000020:00000080:1.0:1786960627.969720:0:5791:0:(genops.c:1406:class_connect()) connect: client c3f21e71-ba64-41c6-8589-43a20e36767f, cookie 0x1808d16e4c97f1e8 00000100:00080000:1.0:1786960627.969735:0:5791:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1786960627.969740:0:5791:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import 00000000c56fdbcc using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1786960627.969797:0:5791:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000091e7ccf9 x1873763967697024/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786960627.969828:0:5791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c3f21e71-ba64-41c6-8589-43a20e36767f->MGS 00000020:01000004:1.0:1786960627.969847:0:5791:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1786960627.969852:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1786960627.969865:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000c79a08b) 00000020:00000080:1.0:1786960627.969878:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1786960627.970054:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000091e7ccf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967697024:0@lo:250: 00000100:00100000:3.0:1786960627.970154:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960627.972319:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697024 00000100:00100000:0.0:1786960627.972333:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697024 00000100:00100000:0.0:1786960627.972388:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786960627.972396:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044a55096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1873763967697024:12345-0@lo:250: 00010000:00080000:0.0:1786960627.972428:0:5803:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from c3f21e71-ba64-41c6-8589-43a20e36767f@0@lo t0 exp 0000000000000000 cur 109 last 0 00000020:00000080:0.0:1786960627.972457:0:5803:0:(genops.c:1406:class_connect()) connect: client c3f21e71-ba64-41c6-8589-43a20e36767f, cookie 0x1808d16e4c97f1f6 00000100:00080000:0.0:1786960627.972622:0:5803:0:(import.c:65:import_set_state_nolock()) 0000000012e50c96 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960627.972727:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044a55096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+5:3284:x1873763967697024:12345-0@lo:250: Request processed in 329us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960627.972735:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786960627.972781:0:3284:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1786960627.972790:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:0.0:1786960627.972798:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1786960627.972803:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1786960627.972807:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000c56fdbcc MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1786960627.972816:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1786960627.972831:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1786960627.972837:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000091e7ccf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967697024:0@lo:250: 00000100:00100000:0.0:1786960627.989040:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786960627.989359:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1786960627.989366:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1786960627.990481:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1786960627.990490:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1786960627.990961:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1786960627.990968:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1786960627.991838:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786960627.991988:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1786960627.991993:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1786960627.993502:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1786960627.993579:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1786960628.068769:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960628.068956:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1786960628.068964:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1786960628.080021:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1786960628.080037:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786960628.086770:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960628.086939:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786960628.086946:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1786960628.088930:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786960628.088940:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1786960628.091459:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960628.091639:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786960628.091645:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1786960628.092151:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786960628.092158:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1786960628.092844:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960628.092954:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786960628.092958:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1786960628.093904:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786960628.093915:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1786960628.127594:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960628.127873:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786960628.127890:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1786960628.129223:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786960628.129242:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1786960628.130828:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786960628.130847:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1786960628.131648:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1786960628.131668:0:5791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1786960628.131674:0:5791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786960628.131802:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786960628.131834:0:5791:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1786960628.131839:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786960628.131840:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786960628.131842:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960628.131843:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960628.131845:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960628.131846:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960628.131847:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786960628.131849:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786960628.131850:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786960628.131851:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786960628.131853:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960628.131854:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960628.131857:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1786960628.131859:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786960628.131860:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786960628.131861:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960628.131863:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960628.131864:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960628.131865:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960628.131866:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786960628.131866:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786960628.131867:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786960628.131868:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786960628.131869:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960628.131870:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960628.131906:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786960628.131923:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697152:0@lo:253: 00000100:00100000:3.0:1786960628.131989:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.132075:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 0000000050c4384f going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.132123:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697152 00000100:00100000:2.0:1786960628.132131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697152 00000100:00100000:2.0:1786960628.132493:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960628.132504:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000997456f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+5:5791:x1873763967697152:12345-0@lo:253: 20000000:01000000:2.0:1786960628.132557:0:5805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786960628.132561:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1786960628.132870:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1786960628.132913:0:5805:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1786960628.133173:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960628.134109:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1786960628.134486:0:5805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1786960628.134490:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1786960628.134496:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1786960628.134499:0:5805:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1786960628.134514:0:5805:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1786960628.134707:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960628.134959:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1786960628.134973:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786960628.135026:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1786960628.135076:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1786960628.135108:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1786960628.138574:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1786960628.138607:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1786960628.138717:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1786960628.138728:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1786960628.138764:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1786960628.138772:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1786960628.138806:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1786960628.138881:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1786960628.138947:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1786960628.138956:0:5805:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1786960628.138972:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786960628.139137:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1786960628.139148:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1786960628.139430:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1786960628.139479:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1786960628.139529:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1786960628.139542:0:5805:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1786960628.139620:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1786960628.139630:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1786960628.139677:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1786960628.139717:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1786960628.139754:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1786960628.139766:0:5805:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1786960628.139857:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1786960628.139867:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1786960628.139902:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1786960628.139941:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1786960628.140136:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1786960628.140483:0:5805:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1786960628.140491:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1786960628.140951:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1786960628.141440:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1786960628.141472:0:5805:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.123@tcp for mdt 20000000:01000000:3.0:1786960628.141474:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:3.0:1786960628.141516:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1786960628.141524:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1786960628.141556:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1786960628.141563:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:3.0:1786960628.141608:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1786960628.141619:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1786960628.141668:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1786960628.141705:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1786960628.141770:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1786960628.141774:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1786960628.141779:0:5805:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1786960628.141784:0:5805:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1786960628.142291:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1786960628.142412:0:5805:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1786960628.154224:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1786960628.154293:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1786960628.154408:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1786960628.154431:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1786960628.154433:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1786960628.154438:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1786960628.154452:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786960628.154467:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1786960628.154497:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1786960628.154500:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786960628.154901:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1786960628.155139:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1786960628.155180:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1786960628.155267:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1786960628.155280:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786960628.155282:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786960628.157726:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1786960628.158007:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1786960628.158044:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1786960628.158103:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1786960628.158119:0:5805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786960628.158122:0:5805:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1786960628.158129:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786960628.158150:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158168:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158178:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158219:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158246:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158252:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158258:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9ae80fa already unused, calling callback (000000009e2b144a) 00010000:00010000:1.0:1786960628.158261:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158268:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158283:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158308:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.158314:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d9ae80fa/0x1808d16e4c97f1fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786960628.158331:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786960628.411776:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000997456f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+5:5791:x1873763967697152:12345-0@lo:253: Request processed in 279267us (279779us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.411790:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960628.411871:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697152:0@lo:253: 10000000:01000000:3.0:1786960628.411888:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786960628.411898:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786960628.411900:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786960628.411902:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960628.411903:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1786960628.411904:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960628.411905:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960628.411906:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786960628.411908:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786960628.411909:0:5791:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1786960628.411910:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960628.411912:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786960628.411930:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009505c1b8 from lustre-MDT0000 10000000:01000000:3.0:1786960628.411955:0:5791:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1786960628.411958:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786960628.411962:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97664e5c8000 10000000:01000000:3.0:1786960628.411966:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786960628.411973:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97664e5c8000 from 1 10000000:01000000:3.0:1786960628.411976:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786960628.412012:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.412022:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.412031:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.412047:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697280:0@lo:101: 00000100:00100000:3.0:1786960628.412080:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.413810:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.414637:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697280 00000100:00100000:0.0:1786960628.414648:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697280 00000100:00100000:0.0:1786960628.414712:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786960628.414723:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceec4eca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:5791:x1873763967697280:12345-0@lo:101: 00010000:00010000:0.0:1786960628.414744:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960628.414768:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039aada08/0x1808d16e4c97f20b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f204 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.414798:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039aada08/0x1808d16e4c97f20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.414874:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039aada08/0x1808d16e4c97f20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.414884:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039aada08, rc 0) 00000100:00100000:0.0:1786960628.415011:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceec4eca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+6:5791:x1873763967697280:12345-0@lo:101: Request processed in 289us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.415018:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960628.415093:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697280:0@lo:101: 00010000:00010000:3.0:1786960628.415109:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.415134:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.415394:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697408:0@lo:501: 00000100:00100000:3.0:1786960628.415560:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.415594:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.415759:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697408 00000100:00100000:2.0:1786960628.415765:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697408 00000100:00100000:2.0:1786960628.415854:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960628.415873:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084bf25c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+6:5791:x1873763967697408:12345-0@lo:501: 00000100:00100000:2.0:1786960628.416522:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084bf25c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+6:5791:x1873763967697408:12345-0@lo:501: Request processed in 650us (961us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786960628.416532:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960628.416597:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697408:0@lo:501: 10000000:01000000:3.0:1786960628.416631:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786960628.416765:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.416777:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000a0e95d47/0x1808d16e4c97f204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960628.416786:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff976652341800 10000000:01000000:3.0:1786960628.416791:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786960628.416795:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff976652341800 10000000:01000000:3.0:1786960628.416798:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1786960628.416800:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff976652341800 from 1 10000000:01000000:3.0:1786960628.416803:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1786960628.416830:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.416837:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.416846:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.416874:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697536:0@lo:101: 00000100:00100000:3.0:1786960628.416906:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.416936:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.416993:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697536 00000100:00100000:0.0:1786960628.416999:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697536 00000100:00100000:0.0:1786960628.417075:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786960628.417092:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070f3d736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+6:5791:x1873763967697536:12345-0@lo:101: 00010000:00010000:0.0:1786960628.417104:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960628.417116:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c156567/0x1808d16e4c97f219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f212 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.417149:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c156567/0x1808d16e4c97f219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f212 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.417167:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c156567/0x1808d16e4c97f219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f212 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.417176:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c156567, rc 0) 00000100:00100000:0.0:1786960628.417245:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070f3d736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+7:5791:x1873763967697536:12345-0@lo:101: Request processed in 156us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.417251:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960628.417318:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697536:0@lo:101: 00010000:00010000:3.0:1786960628.417329:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.417337:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960628.417350:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1786960628.417638:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.417646:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000009fd763e1/0x1808d16e4c97f212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960628.417653:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786960628.417723:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786960628.417728:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff976652341800 10000000:01000000:3.0:1786960628.417731:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1786960628.417733:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1786960628.417735:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786960628.417750:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.417757:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.417775:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.417786:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697664:0@lo:101: 00000100:00100000:3.0:1786960628.417814:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.417841:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.417893:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697664 00000100:00100000:2.0:1786960628.417898:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697664 00000100:00100000:2.0:1786960628.417934:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960628.417940:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f8d26c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+7:5791:x1873763967697664:12345-0@lo:101: 00010000:00010000:2.0:1786960628.417948:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960628.417957:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd434db1/0x1808d16e4c97f227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f220 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.417969:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd434db1/0x1808d16e4c97f227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.417976:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd434db1/0x1808d16e4c97f227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.417981:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd434db1, rc 0) 00000100:00100000:2.0:1786960628.418006:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f8d26c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+8:5791:x1873763967697664:12345-0@lo:101: Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.418011:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960628.418116:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697664:0@lo:101: 00010000:00010000:3.0:1786960628.418126:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.418263:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.418378:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697792:0@lo:501: 00000100:00100000:3.0:1786960628.418404:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.418434:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.418486:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697792 00000100:00100000:2.0:1786960628.418490:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697792 00000100:00100000:2.0:1786960628.418511:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960628.418516:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6391af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+8:5791:x1873763967697792:12345-0@lo:501: 00000100:00100000:2.0:1786960628.418826:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6391af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5791:x1873763967697792:12345-0@lo:501: Request processed in 310us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.418843:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960628.418965:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697792:0@lo:501: 00000100:00100000:3.0:1786960628.418992:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697920:0@lo:503: 00000100:00100000:3.0:1786960628.419029:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.419051:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000206e9815 going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.419103:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967697920 00000100:00100000:2.0:1786960628.419108:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967697920 00000100:00100000:2.0:1786960628.419403:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786960628.419412:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d33d5f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5791:x1873763967697920:12345-0@lo:503: 00000100:00100000:2.0:1786960628.419612:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d33d5f58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5791:x1873763967697920:12345-0@lo:503: Request processed in 201us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.419619:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960628.419838:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d33ab7e0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967697920:0@lo:503: 00000100:00100000:2.0:1786960628.420808:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004097a083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5834:1873763967698048:0@lo:502: 00000100:00100000:2.0:1786960628.423749:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960628.423888:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076733af5 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.423970:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698048 00000100:00100000:0.0:1786960628.423980:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698048 00000100:00100000:0.0:1786960628.424072:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786960628.424084:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021e431b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5834:x1873763967698048:12345-0@lo:502: 00000100:00100000:0.0:1786960628.424583:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021e431b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5834:x1873763967698048:12345-0@lo:502: Request processed in 501us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.424591:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786960628.424690:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004097a083 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5834:1873763967698048:0@lo:502: 00000020:01000000:3.0:1786960628.424725:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960628.424736:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960628.424739:0:5834:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786960628.424743:0:5834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786960628.424753:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786960628.424767:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003c0c905e) 00000020:00000080:3.0:1786960628.424786:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1786960628.424793:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786960628.424882:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786960628.424889:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f235 00000020:00000080:3.0:1786960628.425156:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786960628.425171:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960628.425175:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960628.425176:0:5834:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786960628.425179:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960628.425183:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960628.425204:0:5834:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786960628.425209:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786960628.425217:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000dc1ad383) 00000020:00000080:3.0:1786960628.425240:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1786960628.425246:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786960628.425247:0:5834:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786960628.425250:0:5834:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786960628.425256:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786960628.425312:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009505c1b8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786960628.425325:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000dfc8aa71) 00000020:00000080:3.0:1786960628.425333:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1786960628.425382:0:5834:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786960628.425387:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c97f24a 00000020:00000080:3.0:1786960628.425486:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786960628.425492:0:5834:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786960628.425498:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1808d16e4c97f251 00080000:01000000:3.0:1786960628.425502:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786960628.425505:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f258 00080000:10000000:3.0:1786960628.425904:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1786960628.426100:0:5834:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1786960628.434953:0:5834:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1786960628.521352:0:5834:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1786960628.521824:0:5834:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1786960628.524896:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1786960628.525167:0:5834:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1786960628.582871:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cd784960) 00000020:00000080:1.0:1786960628.582892:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1786960628.582950:0:5834:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1786960628.582964:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f266 00000020:00000080:1.0:1786960628.585770:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1786960628.587335:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960628.644438:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960628.675384:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960628.704841:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960628.743867:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960628.802043:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1786960628.835563:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1808d16e4c97f26d 00000020:00000080:2.0:1786960628.836328:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1786960628.836340:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960628.836346:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960628.836348:0:5834:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1786960628.836356:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960628.836362:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960628.836364:0:5834:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1786960628.836368:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786960628.836402:0:5834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1786960628.836416:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960628.836419:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960628.836421:0:5834:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1786960628.836428:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960628.836431:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960628.836432:0:5834:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960628.836436:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960628.836438:0:5834:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786960628.836505:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5834:1873763967698176:0@lo:502: 00000100:00100000:2.0:1786960628.836594:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960628.836656:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fdb49a2 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.837234:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698176 00000100:00100000:0.0:1786960628.837244:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698176 00000100:00100000:0.0:1786960628.837295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786960628.837304:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4dee82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5834:x1873763967698176:12345-0@lo:502: 00000100:00100000:0.0:1786960628.837711:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4dee82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5834:x1873763967698176:12345-0@lo:502: Request processed in 408us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.837719:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960628.837773:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5834:1873763967698176:0@lo:502: 00000020:01000000:2.0:1786960628.837803:0:5834:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960628.837808:0:5834:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960628.837810:0:5834:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786960628.837818:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1786960628.839043:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1786960628.839066:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786960628.839132:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.839145:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000b90ac1f9/0x1808d16e4c97f220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960628.839153:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff976652341800 from 1 10000000:01000000:0.0:1786960628.839156:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786960628.839236:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.839245:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.839255:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960628.839274:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698304:0@lo:101: 00000100:00100000:0.0:1786960628.839320:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960628.839361:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3dcd998 going to sleep for 11 seconds 00000100:00100000:2.0:1786960628.839456:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698304 00000100:00100000:2.0:1786960628.839464:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698304 00000100:00100000:2.0:1786960628.839509:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960628.839517:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e3b2566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+9:5791:x1873763967698304:12345-0@lo:101: 00010000:00010000:2.0:1786960628.839532:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960628.839545:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f274 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.839571:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.839580:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.839591:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c40ac7f8, rc 0) 00000100:00100000:2.0:1786960628.839636:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e3b2566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+10:5791:x1873763967698304:12345-0@lo:101: Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.839643:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786960628.839754:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698304:0@lo:101: 00010000:00010000:0.0:1786960628.839767:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.839786:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960628.840377:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698432:0@lo:256: 00000100:00100000:0.0:1786960628.840412:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960628.840434:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3dcd998 going to sleep for 11 seconds 00000100:00100000:3.0:1786960628.840565:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698432 00000100:00100000:3.0:1786960628.840570:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698432 00000100:00100000:3.0:1786960628.840595:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960628.840600:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000107507ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+10:5791:x1873763967698432:12345-0@lo:256: 20000000:01000000:3.0:1786960628.840616:0:5803:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1786960628.840621:0:5803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1786960628.840684:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000107507ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+10:5791:x1873763967698432:12345-0@lo:256: Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960628.840691:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786960628.840769:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698432:0@lo:256: 10000000:01000000:0.0:1786960628.841508:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786960628.842579:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.842593:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960628.842601:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff976652341800 from 1 10000000:01000000:0.0:1786960628.842603:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786960628.842639:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.842646:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.842655:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960628.842674:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698560:0@lo:101: 00000100:00100000:0.0:1786960628.842720:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960628.842769:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c3dcd998 going to sleep for 11 seconds 00000100:00100000:3.0:1786960628.842828:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698560 00000100:00100000:3.0:1786960628.842836:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698560 00000100:00100000:3.0:1786960628.842882:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960628.842890:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba61430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+10:5791:x1873763967698560:12345-0@lo:101: 00010000:00010000:3.0:1786960628.842903:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960628.842916:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f282 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.842937:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.842947:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.842956:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053cde7c2, rc 0) 00000100:00100000:3.0:1786960628.843000:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba61430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698560:12345-0@lo:101: Request processed in 111us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960628.843006:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786960628.843251:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3424042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698560:0@lo:101: 00010000:00010000:2.0:1786960628.843266:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.843280:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960628.843334:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698688:0@lo:501: 00000100:00100000:2.0:1786960628.843362:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960628.843381:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061e95f55 going to sleep for 11 seconds 00000100:00100000:1.0:1786960628.843434:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698688 00000100:00100000:1.0:1786960628.843438:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698688 00000100:00100000:1.0:1786960628.843467:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960628.843473:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009a57c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698688:12345-0@lo:501: 00000100:00100000:1.0:1786960628.844022:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009a57c13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698688:12345-0@lo:501: Request processed in 549us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960628.844030:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786960628.844165:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698688:0@lo:501: 00000100:00100000:2.0:1786960628.844241:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698816:0@lo:503: 00000100:00100000:2.0:1786960628.844279:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960628.844301:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061e95f55 going to sleep for 11 seconds 00000100:00100000:1.0:1786960628.844429:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698816 00000100:00100000:1.0:1786960628.844434:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698816 00000100:00100000:1.0:1786960628.844497:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960628.844504:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000194413c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698816:12345-0@lo:503: 00000040:00080000:1.0:1786960628.844540:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786960628.844585:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000194413c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698816:12345-0@lo:503: Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960628.844592:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786960628.844649:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698816:0@lo:503: 00000040:00080000:2.0:1786960628.845423:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1786960628.845574:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1786960628.845590:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786960628.845614:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.845624:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960628.845666:0:5791:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786960628.845669:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff976652341800 10000000:01000000:3.0:1786960628.845672:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff976652341800 10000000:01000000:3.0:1786960628.845676:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786960628.845680:0:5791:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff976652341800 from 1 10000000:01000000:3.0:1786960628.845683:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786960628.845709:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.845716:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.845724:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.845739:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698944:0@lo:101: 00000100:00100000:3.0:1786960628.845771:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.846101:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0fd679f going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.846334:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967698944 00000100:00100000:0.0:1786960628.846342:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967698944 00000100:00100000:0.0:1786960628.846375:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786960628.846383:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000073092e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967698944:12345-0@lo:101: 00010000:00010000:0.0:1786960628.846397:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960628.846409:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057dbdd91/0x1808d16e4c97f297 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f290 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.846431:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057dbdd91/0x1808d16e4c97f297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.846441:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057dbdd91/0x1808d16e4c97f297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960628.846451:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057dbdd91, rc 0) 00000100:00100000:0.0:1786960628.846499:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000073092e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967698944:12345-0@lo:101: Request processed in 116us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.846505:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960628.846586:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967698944:0@lo:101: 00010000:00010000:3.0:1786960628.846600:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.846607:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.846663:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699072:0@lo:501: 00000100:00100000:3.0:1786960628.846689:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.846763:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0fd679f going to sleep for 11 seconds 00000100:00100000:1.0:1786960628.846868:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699072 00000100:00100000:1.0:1786960628.846873:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699072 00000100:00100000:2.0:1786960628.846910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786960628.846917:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067aa9b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967699072:12345-0@lo:501: 00000100:00100000:2.0:1786960628.847142:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067aa9b47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967699072:12345-0@lo:501: Request processed in 225us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960628.847148:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960628.847218:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699072:0@lo:501: 00000100:00100000:3.0:1786960628.847254:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699200:0@lo:503: 00000100:00100000:3.0:1786960628.847288:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.849459:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a0fd679f going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.849559:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699200 00000100:00100000:0.0:1786960628.849568:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699200 00000100:00100000:0.0:1786960628.849613:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786960628.849621:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e7a6017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967699200:12345-0@lo:503: 00000100:00100000:0.0:1786960628.850146:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e7a6017 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967699200:12345-0@lo:503: Request processed in 524us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.850154:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960628.850529:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699200:0@lo:503: 00000100:00100000:3.0:1786960628.851104:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5840:1873763967699328:0@lo:502: 00000100:00100000:3.0:1786960628.851375:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.851444:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045ad2c81 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.851481:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699328 00000100:00100000:0.0:1786960628.851487:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699328 00000100:00100000:0.0:1786960628.851550:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786960628.851566:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c125acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5840:x1873763967699328:12345-0@lo:502: 00000100:00100000:0.0:1786960628.851837:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c125acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5840:x1873763967699328:12345-0@lo:502: Request processed in 272us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.851845:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786960628.851924:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5840:1873763967699328:0@lo:502: 00000020:01000004:3.0:1786960628.851977:0:5840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786960628.852000:0:5840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000049c073a5) 00000020:00000080:3.0:1786960628.852020:0:5840:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1786960628.852352:0:5840:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009505c1b8 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786960628.852357:0:5840:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009505c1b8 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786960628.852360:0:5840:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009505c1b8 4 00010000:00080000:3.0:1786960628.852388:0:5840:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000edb0d2b0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960628.854601:0:5840:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1786960628.854699:0:5840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786960628.854733:0:5840:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786960628.854746:0:5840:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1808d16e4c97f2a5 00000100:00080000:3.0:1786960628.854756:0:5840:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960628.854761:0:5840:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000edb0d2b0 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960628.854808:0:5840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000895e9e13 x1873763967699456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786960628.854838:0:5840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786960628.856495:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967699456:0@lo:38: 00000100:00100000:0.0:1786960628.856569:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960628.856655:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699456 00000100:00100000:0.0:1786960628.856664:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699456 00000100:00100000:0.0:1786960628.856698:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786960628.856705:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874e66da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1873763967699456:12345-0@lo:38: 00000100:00100000:0.0:1786960628.856764:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874e66da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1873763967699456:12345-0@lo:38: Request processed in 57us (194us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786960628.856771:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960628.856859:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786960628.856867:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000edb0d2b0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786960628.856872:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786960628.856875:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967699456:0@lo:38: 00000100:00100000:3.0:1786960628.857829:0:5840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5840:1873763967699584:0@lo:502: 00000100:00100000:3.0:1786960628.857884:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.857913:0:5840:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045ad2c81 going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.858062:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699584 00000100:00100000:0.0:1786960628.858069:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699584 00000100:00100000:0.0:1786960628.858114:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786960628.858121:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b4c427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5840:x1873763967699584:12345-0@lo:502: 00000100:00100000:0.0:1786960628.858371:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b4c427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5840:x1873763967699584:12345-0@lo:502: Request processed in 250us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960628.858378:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786960628.858534:0:5840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:5840:1873763967699584:0@lo:502: 00000040:00080000:3.0:1786960628.858558:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1786960628.858824:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1786960628.858840:0:5791:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786960628.858853:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960628.858864:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 000000004f99205b/0x1808d16e4c97f290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786960628.858919:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786960628.858921:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960628.858923:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960628.858924:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960628.858925:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960628.858927:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960628.858928:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960628.858929:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960628.858930:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786960628.858932:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786960628.858933:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960628.858935:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786960628.858938:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1786960628.858940:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786960628.858942:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960628.858943:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960628.858944:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960628.858945:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960628.858946:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960628.858947:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960628.858948:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960628.858948:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786960628.858949:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786960628.858950:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960628.858951:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786960628.858967:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786960628.858976:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699712:0@lo:253: 00000100:00100000:2.0:1786960628.859009:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960628.859029:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1f24a0b going to sleep for 11 seconds 00000100:00100000:0.0:1786960628.859123:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699712 00000100:00100000:0.0:1786960628.859128:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699712 00000100:00100000:0.0:1786960628.859161:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1786960628.859168:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f102b3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5791:x1873763967699712:12345-0@lo:253: 20000000:01000000:0.0:1786960628.859214:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786960628.859235:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786960628.887423:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786960628.887481:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786960628.887715:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786960628.887721:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786960628.887742:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.887763:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.887771:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.887812:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.887827:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 12 pid: 5804 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960628.887858:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967699840:0@lo:104: 00000100:00100000:3.0:1786960628.887920:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960628.888011:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045ad2c81 going to sleep for 11 seconds 00000100:00100000:1.0:1786960628.888595:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699840 00000100:00100000:1.0:1786960628.888605:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699840 00000100:00100000:1.0:1786960628.888695:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960628.888712:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003ff01f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967699840:12345-0@lo:104: 00010000:00010000:1.0:1786960628.888727:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.888798:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960628.888803:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003ff01f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967699840:12345-0@lo:104: Request processed in 94us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960628.888810:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960628.888881:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000895e9e13 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967699840:0@lo:104: 00010000:00010000:3.0:1786960628.888901:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889732:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960628.889740:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889748:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000646c05af already unused, calling callback (000000002df46716) 10000000:00010000:1.0:1786960628.889751:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889758:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960628.889764:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960628.889769:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960628.889848:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889855:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960628.889879:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889900:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 00000000646c05af/0x1808d16e4c97f274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f27b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.889918:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960628.889919:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960628.889921:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960628.890004:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000049c5d88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967699968:0@lo:103: 00000100:00100000:2.0:1786960628.890051:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960628.890432:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967699968 00000100:00100000:1.0:1786960628.890439:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967699968 00010000:00010000:1.0:1786960628.890472:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 13 pid: 5804 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960628.890505:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960628.890513:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000998973e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3286:x1873763967699968:12345-0@lo:103: 00010000:00010000:1.0:1786960628.890526:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960628.890531:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 13 pid: 5804 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890542:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 13 pid: 5804 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890555:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f27b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f274 expref: 13 pid: 5804 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890568:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890575:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786960628.890599:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002879146s 00010000:00010000:1.0:1786960628.890602:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890608:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890613:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890618:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890622:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000490acba0 already unused, calling callback (000000009e2b144a) 00010000:00010000:1.0:1786960628.890625:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890631:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890641:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960628.890649:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960628.890687:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000998973e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3286:x1873763967699968:12345-0@lo:103: Request processed in 175us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960628.890695:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960628.890726:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000049c5d88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967699968:0@lo:103: 00010000:00010000:3.0:1786960628.890889:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.890897:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960628.890902:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000490acba0/0x1808d16e4c97f2ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960628.896752:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f102b3cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5791:x1873763967699712:12345-0@lo:253: Request processed in 37576us (37733us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960628.896782:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786960628.896865:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:5791:1873763967699712:0@lo:253: 10000000:01000000:2.0:1786960628.896995:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786960628.897005:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786960628.897007:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960628.897008:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960628.897009:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960628.897011:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960628.897012:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960628.897012:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960628.897014:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960628.897016:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786960628.897017:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786960628.897019:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960628.897021:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786960628.897037:0:5791:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786960628.904869:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1786960628.905512:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786960628.905726:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1786960628.905918:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786960628.906121:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1786960628.906446:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960628.907322:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960628.907508:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960628.907709:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960628.907887:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960628.908080:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960628.908296:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:2.0:1786960628.916321:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1786960628.942693:0:5791:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1786960628.974128:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1786960628.974265:0:5845:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1786960628.974269:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1786960628.974614:0:5846:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1786960628.987653:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1786960628.989793:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1786960628.990420:0:5791:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1786960628.990433:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1786960628.990640:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786960628.992643:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1786960628.994658:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1786960628.994779:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1786960628.995298:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1786960628.995551:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1786960628.999911:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1786960629.000360:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1786960629.000682:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1786960629.000829:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1786960629.001074:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1786960629.004543:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1786960629.004803:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1786960629.005089:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1786960629.005284:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1786960629.005428:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1786960629.007033:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1786960629.007256:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1786960629.009516:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1786960629.009788:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1786960629.011658:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1786960629.011926:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1786960629.012373:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1786960629.012545:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1786960629.012699:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1786960629.012849:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1786960629.013094:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1786960629.013275:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1786960629.013434:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1786960629.013620:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1786960629.013782:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1786960629.013944:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1786960629.014246:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1786960629.014383:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1786960629.014543:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1786960629.014677:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1786960629.014828:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1786960629.015537:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1786960629.015763:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1786960629.026129:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1786960629.072638:0:5791:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1786960629.072667:0:5791:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3e2c1843988 00100000:10000000:1.0:1786960629.072673:0:5791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1786960629.073357:0:5791:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786960629.073371:0:5791:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786960629.073382:0:5791:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1786960629.073405:0:5791:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1786960629.076146:0:5846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1786960629.076250:0:5846:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1786960629.076255:0:5846:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1786960629.941881:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960630.964787:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960631.988578:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960633.016494:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960633.082277:0:6088:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786960634.042756:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786960634.175570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1786960634.175580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786960634.175583:0:8:0:(import.c:65:import_set_state_nolock()) 00000000edb0d2b0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786960634.175604:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000edb0d2b0 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1786960634.175754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fcd8664e x1873763967700224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786960634.176088:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000049c5d88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967700096:0@lo:400: 00000100:00100000:3.0:1786960634.176160:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960634.176239:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fcd8664e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967700224:0@lo:38: 00000100:00100000:3.0:1786960634.176267:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960634.177467:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700224 00000100:00100000:0.0:1786960634.177479:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700224 00000100:00100000:0.0:1786960634.177518:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786960634.177527:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000895e9e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1873763967700224:12345-0@lo:38: 00010000:00080000:0.0:1786960634.177556:0:5812:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:0.0:1786960634.177590:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1808d16e4c97f2b3 00000004:00100000:0.0:1786960634.177622:0:5812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1786960634.177977:0:5812:0:(import.c:65:import_set_state_nolock()) 000000009e3eb6c6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960634.178060:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000895e9e13 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1873763967700224:12345-0@lo:38: Request processed in 533us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960634.178068:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786960634.178119:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fcd8664e x1873763967700224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960644 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786960634.178135:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786960634.178143:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786960634.178148:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786960634.178150:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000edb0d2b0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786960634.178155:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fcd8664e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967700224:0@lo:38: 00000100:00100000:2.0:1786960634.178866:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700096 00000100:00100000:2.0:1786960634.178874:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700096 00000100:00100000:2.0:1786960634.178912:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786960634.178918:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005437127d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3287:x1873763967700096:12345-0@lo:400: 00000100:00100000:2.0:1786960634.178980:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005437127d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3287:x1873763967700096:12345-0@lo:400: Request processed in 62us (2821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960634.178987:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786960634.179707:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000049c5d88e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967700096:0@lo:400: 00010000:00010000:3.0:1786960635.060509:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960636.084346:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786960636.214113:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786960636.214120:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff976652341800 from 3 10000000:01000000:0.0:1786960636.214125:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786960636.214170:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960636.214220:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960636.214232:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960636.214256:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007878255f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967700352:0@lo:101: 00000100:00100000:0.0:1786960636.214321:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960636.214386:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c9611907 going to sleep for 11 seconds 00000100:00100000:2.0:1786960636.214808:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700352 00000100:00100000:2.0:1786960636.214818:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700352 00000100:00100000:2.0:1786960636.214879:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786960636.214889:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e7b1c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5807:x1873763967700352:12345-0@lo:101: 00010000:00010000:2.0:1786960636.214906:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960636.214923:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000605cfeb5/0x1808d16e4c97f2c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f2ba expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960636.214951:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000605cfeb5/0x1808d16e4c97f2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960636.214962:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000605cfeb5/0x1808d16e4c97f2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960636.214972:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000605cfeb5, rc 0) 00000100:00100000:2.0:1786960636.215034:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e7b1c54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967700352:12345-0@lo:101: Request processed in 147us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960636.215042:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786960636.215076:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007878255f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967700352:0@lo:101: 00010000:00010000:1.0:1786960636.215092:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960636.215100:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960636.215152:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026811402 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967700480:0@lo:256: 00000100:00100000:1.0:1786960636.215217:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960636.215242:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 000000005f8adcd3 going to sleep for 11 seconds 00000100:00100000:0.0:1786960636.215389:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700480 00000100:00100000:0.0:1786960636.215393:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700480 00000100:00100000:0.0:1786960636.215466:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786960636.215473:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da313841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967700480:12345-0@lo:256: 20000000:01000000:0.0:1786960636.215488:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786960636.215502:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786960636.215505:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1786960636.215581:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da313841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967700480:12345-0@lo:256: Request processed in 109us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960636.215590:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786960636.216070:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026811402 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967700480:0@lo:256: 10000000:01000000:1.0:1786960636.216113:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786960636.216120:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960636.216129:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: 0000000044039792/0x1808d16e4c97f2ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960637.108815:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786960637.851394:0:6290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd69ce3e50 20000000:00000080:2.0:1786960637.851412:0:6290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff976674ac8000 uarg=0000000000000000 20000000:01000000:2.0:1786960637.851447:0:6290:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1786960637.851454:0:6290:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1786960637.851459:0:6290:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1786960637.851647:0:6290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1786960637.851657:0:6290:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1786960637.858594:0:6290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960637.858853:0:6290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1786960637.858919:0:6290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1786960637.858966:0:6290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1786960637.858985:0:6290:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786960637.859004:0:6290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.859035:0:6290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.859043:0:6290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.859086:0:6290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.859103:0:6290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 11 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960637.859118:0:6290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6290:1873763967700608:0@lo:104: 00000100:00100000:2.0:1786960637.860609:0:6290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960637.860667:0:6290:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e23c55e7 going to sleep for 11 seconds 00000100:00100000:1.0:1786960637.861691:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700608 00000100:00100000:1.0:1786960637.861704:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700608 00000100:00100000:1.0:1786960637.861777:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786960637.861786:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068b947c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:6290:x1873763967700608:12345-0@lo:104: 00010000:00010000:1.0:1786960637.861806:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.861892:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960637.861897:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068b947c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:6290:x1873763967700608:12345-0@lo:104: Request processed in 113us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960637.861905:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1786960637.861927:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960637.861932:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.861940:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000000bc71ba already unused, calling callback (000000002df46716) 10000000:00010000:1.0:1786960637.861943:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.861950:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960637.861972:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960637.861976:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786960637.862014:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862020:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960637.862038:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862044:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: 0000000000bc71ba/0x1808d16e4c97f282 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f289 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862060:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960637.862062:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960637.862063:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960637.862082:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026811402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967700736:0@lo:103: 00000100:00100000:1.0:1786960637.862117:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960637.862173:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700736 00000100:00100000:1.0:1786960637.862178:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700736 00010000:00010000:1.0:1786960637.862222:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 12 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960637.862244:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786960637.862250:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000824b7985 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3288:x1873763967700736:12345-0@lo:103: 00010000:00010000:1.0:1786960637.862260:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960637.862276:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 12 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862292:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 12 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862319:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862327:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862341:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862346:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862352:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862357:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862362:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c40ac7f8 already unused, calling callback (000000009e2b144a) 00010000:00010000:1.0:1786960637.862365:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862371:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.862378:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.862521:0:6290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000053cde7c2/0x1808d16e4c97f289 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f282 expref: 12 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960637.862542:0:6290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6290:1873763967700608:0@lo:104: 00010000:00010000:2.0:1786960637.862562:0:6290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.862571:0:6290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960637.862575:0:6290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.863485:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c40ac7f8/0x1808d16e4c97f2c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960637.863502:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960637.863561:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000824b7985 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3288:x1873763967700736:12345-0@lo:103: Request processed in 1310us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960637.863569:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960637.864729:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026811402 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967700736:0@lo:103: 00010000:00010000:3.0:1786960638.132555:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960639.156430:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960639.284658:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a32e0862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967700992:0@lo:400: 00000100:00100000:1.0:1786960639.284733:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960639.284804:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960639.284810:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967700864:0@lo:400: 00000100:00100000:1.0:1786960639.284837:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960639.284864:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700864 00000100:00100000:1.0:1786960639.284872:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700864 00000100:00100000:1.0:1786960639.284916:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786960639.284925:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6050eb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3286:x1873763967700864:12345-0@lo:400: 00000100:00100000:1.0:1786960639.284975:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6050eb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3286:x1873763967700864:12345-0@lo:400: Request processed in 51us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960639.284982:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786960639.285040:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ad4eaf95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967700864:0@lo:400: 00000100:00100000:2.0:1786960639.285351:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967700992 00000100:00100000:2.0:1786960639.285356:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967700992 00000100:00100000:2.0:1786960639.285390:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960639.285396:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad98f8d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967700992:12345-0@lo:400: 00000100:00100000:2.0:1786960639.285442:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad98f8d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967700992:12345-0@lo:400: Request processed in 47us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960639.285449:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786960639.285526:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a32e0862 x1873763967700992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960639.285556:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a32e0862 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967700992:0@lo:400: 00010000:00010000:3.0:1786960640.181478:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960641.204371:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960642.235826:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786960642.359511:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786960642.359520:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff976652341800 from 1 10000000:01000000:3.0:1786960642.359526:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786960642.359576:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: 00000000490acba0/0x1808d16e4c97f2cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960642.359589:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: 00000000490acba0/0x1808d16e4c97f2cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960642.359601:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: 00000000490acba0/0x1808d16e4c97f2cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960642.359626:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701120:0@lo:101: 00000100:00100000:3.0:1786960642.359694:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960642.359792:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076938027 going to sleep for 11 seconds 00000100:00100000:0.0:1786960642.359989:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701120 00000100:00100000:0.0:1786960642.360000:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701120 00000100:00100000:0.0:1786960642.360075:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786960642.360087:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed24c5f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:5807:x1873763967701120:12345-0@lo:101: 00010000:00010000:0.0:1786960642.360104:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960642.360119:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7d34166/0x1808d16e4c97f2d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f2cf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960642.360156:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7d34166/0x1808d16e4c97f2d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960642.360179:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7d34166/0x1808d16e4c97f2d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960642.360208:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7d34166, rc 0) 00000100:00100000:0.0:1786960642.360259:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed24c5f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967701120:12345-0@lo:101: Request processed in 175us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960642.360268:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786960642.360560:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701120:0@lo:101: 00010000:00010000:3.0:1786960642.360581:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: 00000000490acba0/0x1808d16e4c97f2cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960642.360590:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: 00000000490acba0/0x1808d16e4c97f2cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960642.360650:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701248:0@lo:501: 00000100:00100000:3.0:1786960642.360683:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960642.360731:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076938027 going to sleep for 11 seconds 00000100:00100000:0.0:1786960642.360844:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701248 00000100:00100000:0.0:1786960642.360849:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701248 00000100:00100000:0.0:1786960642.360884:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786960642.360893:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0cf556c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967701248:12345-0@lo:501: 00000100:00100000:0.0:1786960642.361259:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0cf556c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967701248:12345-0@lo:501: Request processed in 367us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960642.361268:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960642.361684:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701248:0@lo:501: 00000100:00100000:3.0:1786960642.361720:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701376:0@lo:503: 00000100:00100000:3.0:1786960642.361843:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960642.361872:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 0000000076938027 going to sleep for 11 seconds 00000100:00100000:3.0:1786960642.361889:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701376 00000100:00100000:3.0:1786960642.361893:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701376 00000100:00100000:3.0:1786960642.361932:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786960642.361939:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b76917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967701376:12345-0@lo:503: 00000100:00100000:3.0:1786960642.362270:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b76917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967701376:12345-0@lo:503: Request processed in 332us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960642.362278:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786960642.365748:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d312565b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967701376:0@lo:503: 00000100:00100000:3.0:1786960642.367505:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036de5b74 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:6621:1873763967701504:0@lo:502: 00000100:00100000:3.0:1786960642.367585:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960642.367633:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set 000000001875aeef going to sleep for 11 seconds 00000100:00100000:0.0:1786960642.367665:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701504 00000100:00100000:0.0:1786960642.367674:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701504 00000100:00100000:0.0:1786960642.367727:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786960642.367737:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045a2e8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6621:x1873763967701504:12345-0@lo:502: 00000100:00100000:0.0:1786960642.367996:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045a2e8ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6621:x1873763967701504:12345-0@lo:502: Request processed in 259us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960642.368004:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786960642.368153:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036de5b74 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:6621:1873763967701504:0@lo:502: 00000020:01000000:3.0:1786960642.368210:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960642.368220:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960642.368222:0:6621:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786960642.368229:0:6621:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff976652341800 00000020:00000080:3.0:1786960642.368231:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786960642.368272:0:6621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:6621:1873763967701632:0@lo:502: 00000100:00100000:3.0:1786960642.368428:0:6621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960642.368493:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701632 00000100:00100000:0.0:1786960642.368499:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701632 00000100:00100000:0.0:1786960642.368527:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786960642.368533:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6621:x1873763967701632:12345-0@lo:502: 00000100:00100000:3.0:1786960642.368555:0:6621:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960642.368722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6621:x1873763967701632:12345-0@lo:502: Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960642.368737:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786960642.368976:0:6621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:6621:1873763967701632:0@lo:502: 00000020:01000000:3.0:1786960642.368997:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960642.369003:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960642.369010:0:6621:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1786960642.369013:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1786960642.369560:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1786960642.369582:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960642.369593:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960642.369605:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.255441:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786960643.345101:0:6655:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786960643.345107:0:6655:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1786960643.345408:0:6655:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97667ad21800 00000020:01000004:3.0:1786960643.345431:0:6655:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1786960643.345446:0:6655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786960643.345463:0:6655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97667a6e8000) 00000020:00000080:3.0:1786960643.345486:0:6655:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786960643.367268:0:6655:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1786960643.367961:0:6655:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1786960643.414914:0:6655:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1786960643.424631:0:6655:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1786960643.424970:0:6655:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1786960643.425047:0:6655:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1786960643.425079:0:6655:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1786960643.426491:0:6655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1786960643.426578:0:6655:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1786960643.426596:0:6655:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1808d16e4c97f2e4 00000020:01000004:0.0:1786960643.426607:0:6655:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1786960643.426635:0:6655:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1786960643.426639:0:6655:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1786960643.426646:0:6655:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1786960643.426652:0:6655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1786960643.426846:0:6655:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff976673e819c0) 00000020:00000080:0.0:1786960643.426958:0:6655:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1786960643.435551:0:6655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786960643.435767:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1786960643.435774:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1786960643.444292:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1786960643.444308:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1786960643.445263:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1786960643.445280:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1786960643.448405:0:6655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786960643.448636:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1786960643.448644:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1786960643.456279:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1786960643.456299:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1786960643.508330:0:6655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960643.508752:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786960643.508761:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1786960643.510745:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786960643.510762:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1786960643.511605:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1786960643.511615:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1786960643.513971:0:6655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786960643.518565:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1786960643.518614:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1786960643.519708:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1786960643.519720:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1786960643.581885:0:6655:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786960643.582120:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1786960643.582138:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1786960643.592750:0:6655:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1786960643.592774:0:6655:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1786960643.594596:0:6655:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1786960643.594625:0:6655:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1786960643.594633:0:6655:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1786960643.628399:0:6655:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786960643.628444:0:6655:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1786960643.628448:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786960643.628450:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786960643.628452:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960643.628453:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960643.628454:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960643.628456:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960643.628457:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960643.628459:0:6655:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786960643.628460:0:6655:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786960643.628461:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960643.628463:0:6655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786960643.628468:0:6655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1786960643.628470:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786960643.628471:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786960643.628472:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960643.628473:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960643.628474:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960643.628476:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960643.628477:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960643.628478:0:6655:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786960643.628478:0:6655:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786960643.628480:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960643.628480:0:6655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786960643.628509:0:6655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786960643.628531:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967701760:0@lo:253: 00000100:00100000:1.0:1786960643.628616:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.628761:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522a0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.628924:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701760 00000100:00100000:0.0:1786960643.628933:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701760 00000100:00100000:0.0:1786960643.629096:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786960643.629107:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967701760:12345-0@lo:253: 20000000:01000000:0.0:1786960643.629165:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1786960643.629170:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1786960643.629177:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1786960643.629182:0:5805:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1786960643.631338:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786960643.631571:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1786960643.631586:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1786960643.631625:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1786960643.631633:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1786960643.631736:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1786960643.631860:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1786960643.632702:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1786960643.632731:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:0.0:1786960643.632733:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1786960643.632770:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1786960643.633026:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1786960643.633122:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1786960643.633144:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1786960643.633180:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1786960643.633218:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1786960643.633252:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1786960643.633308:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1786960643.636444:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1786960643.636501:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:1.0:1786960643.636504:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:1.0:1786960643.636571:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1786960643.636581:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1786960643.636605:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1786960643.636613:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:1.0:1786960643.638213:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1786960643.638262:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1786960643.638981:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1786960643.639032:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1786960643.639064:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786960643.639067:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786960643.639072:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1786960643.641384:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786960643.641392:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1786960643.641469:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1786960643.641473:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1786960643.645364:0:6670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1786960643.645497:0:6670:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1786960643.645554:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1786960643.646518:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1786960643.646591:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1786960643.646630:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1786960643.646647:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786960643.646650:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1786960643.647493:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1786960643.647556:0:6671:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1786960643.647615:0:6671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1786960643.647986:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1786960643.648299:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1786960643.648405:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1786960643.648425:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1786960643.648427:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786960643.649545:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1786960643.649946:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1786960643.650012:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1786960643.650466:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1786960643.650726:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1786960643.650729:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1786960643.650749:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1786960643.650775:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650808:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650816:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650823:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650831:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650876:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.650892:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.650909:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4ba300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967701888:0@lo:104: 00000100:00100000:2.0:1786960643.650988:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960643.651070:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.651080:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 12 pid: 5805 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.651176:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967701888 00000100:00100000:1.0:1786960643.651203:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967701888 00000100:00100000:1.0:1786960643.651277:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786960643.651290:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967701888:12345-0@lo:104: 00010000:00010000:1.0:1786960643.651304:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.651368:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960643.651375:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967701888:12345-0@lo:104: Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960643.651382:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1786960643.651794:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960643.651803:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.651812:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:0.0:1786960643.651816:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.651824:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960643.651832:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960643.651838:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786960643.651888:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.651896:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786960643.651925:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.651932:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168c00/0x1808d16e4c97f290 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f297 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.651959:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960643.651961:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960643.651962:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960643.652509:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967702016:0@lo:104: 00000100:00100000:2.0:1786960643.652560:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960643.652615:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.652634:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.652644:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967702272:0@lo:104: 00000100:00100000:1.0:1786960643.652850:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967702144:0@lo:103: 00000100:00100000:1.0:1786960643.652886:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.653207:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702016 00000100:00100000:0.0:1786960643.653216:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702016 00000100:00100000:0.0:1786960643.653268:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960643.653347:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967702016:12345-0@lo:104: 00010000:00010000:0.0:1786960643.653361:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.653425:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786960643.653432:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967702016:12345-0@lo:104: Request processed in 156us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.653439:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1786960643.653502:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960643.653510:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960643.653517:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702144 00010000:00010000:1.0:1786960643.653520:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168a00 already unused, calling callback (ffffffffc1b5fc20) 00000100:00100000:3.0:1786960643.653523:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702144 10000000:00010000:1.0:1786960643.653536:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.653548:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 13 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.653549:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960643.653568:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960643.653575:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1786960643.653595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960643.653603:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3287:x1873763967702144:12345-0@lo:103: 00010000:00010000:1.0:1786960643.653608:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.653614:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960643.653616:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960643.653623:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 13 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.653631:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.653638:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 13 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.653641:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f227 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.653675:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960643.653677:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960643.653679:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960643.653690:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960643.653700:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967702400:0@lo:103: 00000100:00100000:1.0:1786960643.653732:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.653767:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786960643.653776:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1786960643.653941:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960643.653980:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3287:x1873763967702144:12345-0@lo:103: Request processed in 379us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.653988:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960643.654002:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702400 00000100:00100000:3.0:1786960643.654013:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702400 00010000:00010000:3.0:1786960643.654026:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 13 pid: 5805 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960643.654041:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960643.654047:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3287:x1873763967702400:12345-0@lo:103: 00010000:00010000:3.0:1786960643.654054:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960643.654058:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 13 pid: 5805 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.654065:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 13 pid: 5805 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.654074:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960643.654165:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967702144:0@lo:103: 00000100:00100000:2.0:1786960643.656976:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.657106:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670c180 going to sleep for 11 seconds 00010000:00010000:2.0:1786960643.657152:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f297 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f290 expref: 13 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.657174:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4ba300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967701888:0@lo:104: 00010000:00010000:2.0:1786960643.657212:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045e00/0x1808d16e4c97f227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f220 expref: 12 pid: 5805 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.657222:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967702016:0@lo:104: 00000100:00100000:1.0:1786960643.657430:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702272 00000100:00100000:1.0:1786960643.657455:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702272 00000100:00100000:0.0:1786960643.657559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786960643.657570:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967702272:12345-0@lo:104: 00010000:00010000:0.0:1786960643.657588:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657683:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960643.657694:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1873763967702272:0@lo:104: 00000100:00100000:0.0:1786960643.657702:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5805:x1873763967702272:12345-0@lo:104: Request processed in 131us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.657712:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1786960643.657735:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657739:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960643.657750:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657759:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:0.0:1786960643.657764:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657773:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960643.657780:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960643.657785:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786960643.657828:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657835:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786960643.657862:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657869:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f20b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.657902:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960643.657904:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960643.657905:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960643.658007:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967702528:0@lo:103: 00000100:00100000:2.0:1786960643.658048:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.658088:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786960643.658099:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702528 00000100:00100000:1.0:1786960643.658104:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702528 00010000:00010000:1.0:1786960643.658137:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.658334:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1786960643.658345:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960643.658354:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3285:x1873763967702528:12345-0@lo:103: 00010000:00010000:2.0:1786960643.658368:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960643.658375:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658387:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658404:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e0400/0x1808d16e4c97f20b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f204 expref: 12 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658428:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658437:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658452:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658460:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658467:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658473:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658479:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960643.658496:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658504:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658528:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.658541:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960643.658579:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3285:x1873763967702528:12345-0@lo:103: Request processed in 226us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.658594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960643.658631:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967702528:0@lo:103: 00010000:00010000:0.0:1786960643.658731:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.658741:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.658747:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044a00/0x1808d16e4c97f2f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786960643.658763:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1786960643.660294:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+10:3287:x1873763967702400:12345-0@lo:103: Request processed in 6227us (6541us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.660309:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786960643.660312:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967702400:0@lo:103: 00000100:00100000:0.0:1786960643.753173:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+9:6655:x1873763967701760:12345-0@lo:253: Request processed in 124057us (124545us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.753219:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786960643.753343:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967701760:0@lo:253: 10000000:01000000:1.0:1786960643.753511:0:6655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786960643.753516:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786960643.753517:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786960643.753518:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960643.753520:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1786960643.753521:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960643.753522:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960643.753524:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960643.753525:0:6655:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1786960643.753527:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960643.753528:0:6655:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1786960643.753551:0:6655:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97667ad21800 from lustre-OST0000 10000000:01000000:1.0:1786960643.753579:0:6655:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1786960643.753582:0:6655:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1786960643.753590:0:6655:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97664e5c8000 local copy 10000000:01000000:1.0:1786960643.753595:0:6655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786960643.753635:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.753648:0:6655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.753677:0:6655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.753699:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702656:0@lo:101: 00000100:00100000:1.0:1786960643.753739:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.753795:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b4206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.753862:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702656 00000100:00100000:0.0:1786960643.753869:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702656 00000100:00100000:0.0:1786960643.753906:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786960643.753918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+9:6655:x1873763967702656:12345-0@lo:101: 00010000:00010000:0.0:1786960643.753931:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960643.753947:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f2f9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.753971:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f2f9 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.753982:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f2f9 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.753991:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1c00, rc 0) 00000100:00100000:0.0:1786960643.754033:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+10:6655:x1873763967702656:12345-0@lo:101: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.754049:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786960643.754181:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702656:0@lo:101: 00010000:00010000:1.0:1786960643.754222:0:6655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.754231:0:6655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.754668:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702784:0@lo:501: 00000100:00100000:1.0:1786960643.754720:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.754747:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b4206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.755263:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702784 00000100:00100000:0.0:1786960643.755271:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702784 00000100:00100000:0.0:1786960643.755318:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786960643.755328:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+10:6655:x1873763967702784:12345-0@lo:501: 00000100:00100000:0.0:1786960643.755588:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+10:6655:x1873763967702784:12345-0@lo:501: Request processed in 261us (868us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786960643.755595:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786960643.755775:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702784:0@lo:501: 10000000:01000000:1.0:1786960643.755795:0:6655:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786960643.755828:0:6655:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786960643.755835:0:6655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.755845:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.755852:0:6655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.755924:0:6655:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786960643.755950:0:6655:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97667ad21800 10000000:01000000:1.0:1786960643.755956:0:6655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786960643.755961:0:6655:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97664e5c8000 10000000:01000000:1.0:1786960643.755964:0:6655:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1786960643.755968:0:6655:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97664e5c8000 from 1 10000000:01000000:1.0:1786960643.755971:0:6655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1786960643.755997:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756006:0:6655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756016:0:6655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.756031:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702912:0@lo:101: 00000100:00100000:1.0:1786960643.756060:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.756091:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960643.756100:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967702912 00000100:00100000:3.0:1786960643.756105:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967702912 00010000:00010000:2.0:1786960643.756141:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1786960643.756147:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786960643.756156:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+10:6655:x1873763967702912:12345-0@lo:101: 00010000:00010000:3.0:1786960643.756165:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960643.756182:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169600/0x1808d16e4c97f30e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f307 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756233:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169600/0x1808d16e4c97f30e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f307 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756242:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169600/0x1808d16e4c97f30e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f307 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756261:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169600, rc 0) 00000100:00100000:3.0:1786960643.756301:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967702912:12345-0@lo:101: Request processed in 147us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.756308:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1786960643.756386:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.756394:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967702912:0@lo:101: 00010000:00010000:2.0:1786960643.756395:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960643.756399:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756405:0:6655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.756407:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756413:0:6655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960643.756415:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960643.756421:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786960643.756428:0:6655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1786960643.756441:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756446:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.756448:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960643.756458:0:6655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960643.756464:0:6655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 00010000:00010000:2.0:1786960643.756466:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960643.756467:0:6655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786960643.756471:0:6655:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00010000:00010000:2.0:1786960643.756473:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169b800/0x1808d16e4c97f2f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f300 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960643.756474:0:6655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786960643.756486:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.756492:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960643.756492:0:6655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.756494:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960643.756500:0:6655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.756501:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960643.756510:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703168:0@lo:101: 00000100:00100000:2.0:1786960643.756512:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967703040:0@lo:103: 00000100:00100000:1.0:1786960643.756536:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.756538:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.756551:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960643.756648:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703168 00000100:00100000:3.0:1786960643.756652:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703168 00000100:00100000:3.0:1786960643.756677:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786960643.756684:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703168:12345-0@lo:101: 00010000:00010000:3.0:1786960643.756691:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960643.756699:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f315 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756713:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756721:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.756727:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169000, rc 0) 00000100:00100000:3.0:1786960643.756762:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703168:12345-0@lo:101: Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.756771:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786960643.756839:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703168:0@lo:101: 00010000:00010000:1.0:1786960643.756850:0:6655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.756857:0:6655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.756931:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703296:0@lo:501: 00000100:00100000:1.0:1786960643.756988:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.757007:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.757026:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703296 00000100:00100000:2.0:1786960643.757031:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703296 00000100:00100000:2.0:1786960643.757061:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786960643.757068:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703296:12345-0@lo:501: 00000100:00100000:2.0:1786960643.757429:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703296:12345-0@lo:501: Request processed in 361us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.757435:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786960643.757634:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703040 00000100:00100000:0.0:1786960643.757639:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703040 00000100:00100000:0.0:1786960643.757687:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960643.757689:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703296:0@lo:501: 00000100:00100000:0.0:1786960643.757695:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3286:x1873763967703040:12345-0@lo:103: 00010000:00010000:0.0:1786960643.757704:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1786960643.757717:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703424:0@lo:503: 00010000:00010000:0.0:1786960643.757718:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f2f9 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.757731:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960643.757753:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.757769:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3286:x1873763967703040:12345-0@lo:103: Request processed in 76us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.757775:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960643.757781:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.757793:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703424 00000100:00100000:0.0:1786960643.757796:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703424 00000100:00100000:0.0:1786960643.757821:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786960643.757827:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703424:12345-0@lo:503: 00000100:00100000:3.0:1786960643.757913:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967703040:0@lo:103: 00000100:00100000:0.0:1786960643.758004:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703424:12345-0@lo:503: Request processed in 176us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.758011:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786960643.758053:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703424:0@lo:503: 00000040:00080000:0.0:1786960643.758964:0:6655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960643.759043:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703552:0@lo:502: 00000100:00100000:0.0:1786960643.759096:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.759145:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786960643.759827:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703552 00000100:00100000:1.0:1786960643.759836:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703552 00000100:00100000:1.0:1786960643.759972:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786960643.759982:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703552:12345-0@lo:502: 00000100:00100000:1.0:1786960643.760491:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703552:12345-0@lo:502: Request processed in 509us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960643.760498:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786960643.760582:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703552:0@lo:502: 00000040:00080000:0.0:1786960643.761084:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786960643.761156:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1786960643.761373:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1786960643.761429:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1786960643.761466:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1786960643.761498:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1786960643.761539:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703680:0@lo:502: 00000100:00100000:0.0:1786960643.761600:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.761702:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.761793:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703680 00000100:00100000:2.0:1786960643.761801:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703680 00000100:00100000:2.0:1786960643.762084:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786960643.762095:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703680:12345-0@lo:502: 00000100:00100000:2.0:1786960643.762684:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703680:12345-0@lo:502: Request processed in 589us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.762693:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786960643.762878:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703680:0@lo:502: 00000040:00080000:0.0:1786960643.763023:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1786960643.763039:0:6655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1786960643.763650:0:6676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786960643.763658:0:6676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1786960643.763715:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960643.763718:0:6676:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1786960643.763723:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786960643.763738:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97664e5ccd40) 00000020:00000080:1.0:1786960643.763757:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786960643.763761:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786960643.763812:0:6676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97667ad21800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1786960643.763817:0:6676:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786960643.763822:0:6676:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1808d16e4c97f32a 00010000:00010000:1.0:1786960643.774235:0:6676:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1786960643.774641:0:6676:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1786960643.784347:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1786960643.787100:0:6676:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1786960643.803659:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1786960643.804318:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1786960643.808747:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1786960643.808763:0:6676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960643.808771:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960643.808773:0:6676:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1786960643.808789:0:6676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960643.808795:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960643.808797:0:6676:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786960643.808801:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786960643.808803:0:6676:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786960643.808886:0:6676:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960643.808890:0:6676:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960643.808891:0:6676:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786960643.808895:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1786960643.809153:0:6655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1786960643.809208:0:6655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786960643.809230:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.809244:0:6655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960643.809254:0:6655:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97667ad21800 from 1 10000000:01000000:2.0:1786960643.809258:0:6655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960643.809301:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.809317:0:6655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.809330:0:6655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.809368:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703808:0@lo:101: 00000100:00100000:2.0:1786960643.811376:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.811460:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a540 going to sleep for 11 seconds 00000100:00100000:1.0:1786960643.811573:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703808 00000100:00100000:1.0:1786960643.811650:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703808 00000100:00100000:1.0:1786960643.811709:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786960643.811719:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:6655:x1873763967703808:12345-0@lo:101: 00010000:00010000:1.0:1786960643.811736:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960643.811757:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f331 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.811788:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.811799:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.811808:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b400, rc 0) 00000100:00100000:1.0:1786960643.811863:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703808:12345-0@lo:101: Request processed in 146us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960643.811870:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786960643.812998:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703808:0@lo:101: 00010000:00010000:2.0:1786960643.813023:0:6655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.813036:0:6655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.813664:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703936:0@lo:501: 00000100:00100000:2.0:1786960643.813744:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.813807:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.813856:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967703936 00000100:00100000:0.0:1786960643.813865:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967703936 00000100:00100000:0.0:1786960643.813906:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786960643.813915:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703936:12345-0@lo:501: 00000100:00100000:0.0:1786960643.814355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967703936:12345-0@lo:501: Request processed in 440us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.814363:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786960643.814454:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967703936:0@lo:501: 00000100:00100000:2.0:1786960643.814509:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704064:0@lo:503: 00000100:00100000:2.0:1786960643.814560:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.814590:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a540 going to sleep for 11 seconds 00000100:00100000:1.0:1786960643.814790:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704064 00000100:00100000:1.0:1786960643.814796:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704064 00000100:00100000:1.0:1786960643.814839:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786960643.814847:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704064:12345-0@lo:503: 00000100:00100000:1.0:1786960643.815027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704064:12345-0@lo:503: Request processed in 180us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960643.815034:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786960643.815342:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704064:0@lo:503: 00000040:00080000:0.0:1786960643.815657:0:6655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960643.815753:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704192:0@lo:502: 00000100:00100000:0.0:1786960643.816437:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.816486:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.816535:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704192 00000100:00100000:2.0:1786960643.816543:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704192 00000100:00100000:2.0:1786960643.816592:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786960643.816612:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704192:12345-0@lo:502: 00000100:00100000:2.0:1786960643.816877:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704192:12345-0@lo:502: Request processed in 266us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.816885:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786960643.817422:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704192:0@lo:502: 00000040:00080000:0.0:1786960643.817746:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1786960643.819419:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1786960643.819490:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704320:0@lo:502: 00000100:00100000:0.0:1786960643.819576:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.819631:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522a0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.819672:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704320 00000100:00100000:2.0:1786960643.819684:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704320 00000100:00100000:2.0:1786960643.819753:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1786960643.819771:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704320:12345-0@lo:502: 00000100:00100000:2.0:1786960643.820120:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704320:12345-0@lo:502: Request processed in 350us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.820136:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786960643.820629:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704320:0@lo:502: 00000040:00080000:0.0:1786960643.821183:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1786960643.822563:0:6655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1786960643.823910:0:6680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960643.823925:0:6680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960643.823937:0:6680:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786960643.823945:0:6680:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97667ad21800 00000020:00000080:0.0:1786960643.823947:0:6680:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786960643.823973:0:6680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960643.823977:0:6680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960643.823978:0:6680:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1786960643.823981:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1786960643.825081:0:6655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1786960643.825131:0:6655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960643.825158:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.825205:0:6655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960643.825531:0:6655:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786960643.825535:0:6655:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97667ad21800 10000000:01000000:1.0:1786960643.825539:0:6655:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97667ad21800 10000000:01000000:1.0:1786960643.825545:0:6655:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786960643.825551:0:6655:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97667ad21800 from 1 10000000:01000000:1.0:1786960643.825554:0:6655:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960643.825598:0:6655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.825606:0:6655:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.825618:0:6655:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.825645:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704448:0@lo:101: 00000100:00100000:1.0:1786960643.825725:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.825781:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960643.825855:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704448 00000100:00100000:0.0:1786960643.825862:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704448 00000100:00100000:0.0:1786960643.825918:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786960643.825928:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967704448:12345-0@lo:101: 00010000:00010000:0.0:1786960643.825942:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960643.825958:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f33f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.825983:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.825994:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.826002:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1c00, rc 0) 00000100:00100000:0.0:1786960643.826054:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704448:12345-0@lo:101: Request processed in 128us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.826061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786960643.827411:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704448:0@lo:101: 00010000:00010000:1.0:1786960643.827440:0:6655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960643.827453:0:6655:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960643.827846:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704576:0@lo:501: 00000100:00100000:1.0:1786960643.827914:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.828033:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.828545:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704576 00000100:00100000:2.0:1786960643.828554:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704576 00000100:00100000:0.0:1786960643.828627:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786960643.828642:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704576:12345-0@lo:501: 00000100:00100000:0.0:1786960643.828948:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704576:12345-0@lo:501: Request processed in 309us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.836676:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786960643.836710:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704576:0@lo:501: 00000100:00100000:1.0:1786960643.836785:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704704:0@lo:503: 00000100:00100000:1.0:1786960643.836878:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.836938:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960643.836961:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704704 00000100:00100000:3.0:1786960643.836970:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704704 00000100:00100000:3.0:1786960643.837024:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786960643.837043:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704704:12345-0@lo:503: 00000100:00100000:3.0:1786960643.837302:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704704:12345-0@lo:503: Request processed in 269us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.837310:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786960643.840493:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704704:0@lo:503: 00000040:00080000:0.0:1786960643.840910:0:6655:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960643.841008:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704832:0@lo:502: 00000100:00100000:0.0:1786960643.841100:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.841183:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522a0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960643.846109:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704832 00000100:00100000:2.0:1786960643.846137:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704832 00000100:00100000:2.0:1786960643.846322:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786960643.846335:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704832:12345-0@lo:502: 00000100:00100000:2.0:1786960643.846989:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704832:12345-0@lo:502: Request processed in 654us (5886us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.846998:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786960643.847046:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704832:0@lo:502: 00000040:00080000:0.0:1786960643.847488:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1786960643.847543:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1786960643.847568:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1786960643.847602:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1786960643.847629:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1786960643.847675:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1786960643.847710:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1786960643.847739:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1786960643.847770:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1786960643.847797:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1786960643.847829:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1786960643.847881:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1786960643.847911:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1786960643.847943:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1786960643.847985:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1786960643.848016:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1786960643.848064:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1786960643.848130:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1786960643.848167:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1786960643.848256:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1786960643.848308:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1786960643.848344:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1786960643.848377:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1786960643.848420:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1786960643.848468:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1786960643.848503:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1786960643.848550:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1786960643.848585:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1786960643.848639:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704960:0@lo:502: 00000100:00100000:0.0:1786960643.848721:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.849086:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522a0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960643.855055:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967704960 00000100:00100000:3.0:1786960643.855075:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967704960 00000100:00100000:0.0:1786960643.855639:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786960643.855651:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704960:12345-0@lo:502: 00000100:00100000:0.0:1786960643.858547:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967704960:12345-0@lo:502: Request processed in 2886us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.858565:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786960643.859618:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967704960:0@lo:502: 00000040:00080000:1.0:1786960643.859831:0:6655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1786960643.860437:0:6655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1786960643.861757:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1786960643.862030:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97664e46b380) 00000020:00000080:2.0:1786960643.862060:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1786960643.865238:0:6681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97667ad21800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786960643.865267:0:6681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97667ad21800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786960643.865271:0:6681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97667ad21800 3 00010000:00080000:3.0:1786960643.865314:0:6681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97667a86f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960643.870700:0:6681:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1786960643.870889:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786960643.870935:0:6681:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786960643.870951:0:6681:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1808d16e4c97f354 00000100:00080000:3.0:1786960643.870963:0:6681:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960643.870970:0:6681:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97667a86f800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960643.871006:0:6681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667a69ed80 x1873763967705088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786960643.871071:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967705088:0@lo:38: 00000100:00100000:0.0:1786960643.871169:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960643.871320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705088 00000100:00100000:1.0:1786960643.871329:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705088 00000100:00080000:3.0:1786960643.871374:0:6681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786960643.871376:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786960643.871386:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1873763967705088:12345-0@lo:38: 00010000:00080000:1.0:1786960643.871415:0:5810:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 125 last 0 00000020:00000080:1.0:1786960643.871445:0:5810:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1808d16e4c97f35b 00000004:00100000:1.0:1786960643.871460:0:5810:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786960643.871495:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9766772e2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786960643.872816:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1873763967705088:12345-0@lo:38: Request processed in 1411us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960643.872830:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1786960643.873214:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97667a69ed80 x1873763967705088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960643.873229:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786960643.873240:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1786960643.873250:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1786960643.873256:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786960643.873260:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a86f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786960643.873269:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967705088:0@lo:38: 00000100:00100000:0.0:1786960643.873373:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786960643.873386:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967705216:0@lo:400: 00000100:00100000:0.0:1786960643.873439:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.873495:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705216 00000100:00100000:0.0:1786960643.873519:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705216 00000100:00100000:0.0:1786960643.873591:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786960643.873601:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967705216:12345-0@lo:400: 00000100:00100000:0.0:1786960643.873655:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967705216:12345-0@lo:400: Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960643.873662:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786960643.873692:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff976673ad3100 x1873763967705216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960643.873704:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967705216:0@lo:400: 00000040:00080000:0.0:1786960643.874570:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1786960643.875270:0:6655:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1786960643.875311:0:6655:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786960643.875332:0:6655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960643.875344:0:6655:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786960643.875420:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786960643.875422:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960643.875423:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960643.875425:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960643.875426:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960643.875427:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960643.875428:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960643.875430:0:6655:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786960643.875431:0:6655:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786960643.875433:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960643.875434:0:6655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786960643.875439:0:6655:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1786960643.875441:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786960643.875442:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960643.875449:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960643.875450:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960643.875451:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960643.875452:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960643.875453:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960643.875454:0:6655:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786960643.875455:0:6655:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786960643.875456:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960643.875456:0:6655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786960643.875483:0:6655:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1786960643.875504:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967705344:0@lo:253: 00000100:00100000:0.0:1786960643.875584:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960643.875631:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705344 00000100:00100000:0.0:1786960643.875638:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705344 00000100:00100000:0.0:1786960643.875683:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786960643.875691:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:6655:x1873763967705344:12345-0@lo:253: 20000000:01000000:0.0:1786960643.875732:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1786960643.875750:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1786960643.877614:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c540 going to sleep for 11 seconds 20000000:01000000:3.0:1786960643.932616:0:5805:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786960643.932671:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1786960643.932717:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786960643.932723:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786960643.932749:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.932771:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.932799:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.932843:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960643.932857:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 13 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.932875:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967705472:0@lo:104: 00000100:00100000:2.0:1786960643.933025:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960643.933216:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960643.933287:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705472 00000100:00100000:3.0:1786960643.933295:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705472 00000100:00100000:3.0:1786960643.933474:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960643.933485:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967705472:12345-0@lo:104: 00010000:00010000:3.0:1786960643.933501:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933564:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786960643.933579:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967705472:12345-0@lo:104: Request processed in 96us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.933587:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1786960643.933652:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960643.933659:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933667:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1e00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960643.933671:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933680:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960643.933686:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960643.933691:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1786960643.933748:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967705472:0@lo:104: 00010000:00010000:1.0:1786960643.933781:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933900:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933907:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960643.933936:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933944:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f2ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2c1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.933972:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960643.933974:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960643.933976:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960643.933990:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960643.934005:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967705600:0@lo:103: 00000100:00100000:3.0:1786960643.934046:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960643.934085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705600 00000100:00100000:3.0:1786960643.934090:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705600 00010000:00010000:3.0:1786960643.934108:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 14 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960643.934151:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960643.934158:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:3287:x1873763967705600:12345-0@lo:103: 00010000:00010000:3.0:1786960643.934170:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960643.934175:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 14 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934225:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 14 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934240:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044800/0x1808d16e4c97f2c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f2ba expref: 14 pid: 5804 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934254:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934262:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786960643.934276:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002879146s 00010000:00010000:3.0:1786960643.934281:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934288:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934301:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934308:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934313:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960643.934317:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934325:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934339:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934348:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960643.934383:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3287:x1873763967705600:12345-0@lo:103: Request processed in 225us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960643.934390:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960643.934460:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967705600:0@lo:103: 00010000:00010000:3.0:1786960643.934479:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934486:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960643.934493:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045400/0x1808d16e4c97f362 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960643.942239:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:6655:x1873763967705344:12345-0@lo:253: Request processed in 66536us (66642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960643.942257:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786960643.942463:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:6655:1873763967705344:0@lo:253: 10000000:01000000:0.0:1786960643.942483:0:6655:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1786960643.942487:0:6655:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786960643.942489:0:6655:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960643.942490:0:6655:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960643.942491:0:6655:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960643.942492:0:6655:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960643.942493:0:6655:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960643.942495:0:6655:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960643.942496:0:6655:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1786960643.942497:0:6655:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1786960643.942499:0:6655:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960643.942500:0:6655:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786960643.942517:0:6655:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786960643.950754:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960643.950974:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786960643.951529:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960643.951754:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786960643.952029:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960643.952599:0:6655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1786960643.954113:0:6655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1786960644.188610:0:6655:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1786960644.188619:0:6655:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1786960644.188655:0:6655:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786960644.188739:0:6655:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786960644.188758:0:6655:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1786960644.189740:0:6655:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1786960644.277335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960645.300576:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960646.325666:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960647.349525:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960648.376204:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960649.012421:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967705728:0@lo:400: 00000100:00100000:2.0:1786960649.012500:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960649.012527:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967705856:0@lo:400: 00000100:00100000:2.0:1786960649.012584:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960649.012596:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967705984:0@lo:400: 00000100:00100000:3.0:1786960649.012610:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960649.012674:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705728 00000100:00100000:0.0:1786960649.012689:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705728 00000100:00100000:0.0:1786960649.012757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786960649.012780:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3285:x1873763967705728:12345-0@lo:400: 00000100:00100000:2.0:1786960649.013608:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960649.013666:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705856 00000100:00100000:2.0:1786960649.013671:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705856 00000100:00100000:2.0:1786960649.013701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967705984 00000100:00100000:2.0:1786960649.013704:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967705984 00000100:00100000:2.0:1786960649.013730:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960649.013746:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967705856:12345-0@lo:400: 00000100:00100000:2.0:1786960649.013805:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967705856:12345-0@lo:400: Request processed in 60us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960649.013813:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960649.013846:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960649.013853:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967705984:12345-0@lo:400: 00000100:00100000:2.0:1786960649.013886:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967705984:12345-0@lo:400: Request processed in 35us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960649.013895:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1786960649.013938:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad3800 x1873763967705984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960649.013953:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967705984:0@lo:400: 00000100:00080000:2.0:1786960649.014026:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786960649.018230:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad0a80 x1873763967705856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960649.018249:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967705856:0@lo:400: 00000100:00100000:0.0:1786960649.018519:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3285:x1873763967705728:12345-0@lo:400: Request processed in 5737us (6015us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960649.018543:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786960649.020232:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967705728:0@lo:400: 00010000:00010000:3.0:1786960649.397429:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960650.272605:0:7026:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786960650.420919:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960651.450551:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786960651.575123:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786960651.575132:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff976652341800 from 21 10000000:01000000:1.0:1786960651.575136:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960651.575212:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.575226:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.575237:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960651.575264:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706112:0@lo:101: 00000100:00100000:1.0:1786960651.575347:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.575404:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647099600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.575433:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706112 00000100:00100000:3.0:1786960651.575441:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706112 00000100:00100000:3.0:1786960651.575501:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786960651.575510:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967706112:12345-0@lo:101: 00010000:00010000:3.0:1786960651.575528:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960651.575542:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f369 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.575567:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.575578:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.575587:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168800, rc 0) 00000100:00100000:3.0:1786960651.575630:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706112:12345-0@lo:101: Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.575636:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786960651.575653:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706112:0@lo:101: 00010000:00010000:2.0:1786960651.575668:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960651.575678:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960651.575752:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706240:0@lo:501: 00000100:00100000:2.0:1786960651.575779:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960651.575798:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2900 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.575849:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706240 00000100:00100000:1.0:1786960651.575859:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706240 00000100:00100000:1.0:1786960651.575891:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960651.575897:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706240:12345-0@lo:501: 00000100:00100000:1.0:1786960651.576238:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706240:12345-0@lo:501: Request processed in 340us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960651.576244:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960651.576284:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706240:0@lo:501: 00000100:00100000:1.0:1786960651.576311:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706368:0@lo:503: 00000100:00100000:1.0:1786960651.576348:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.576367:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647099f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.576378:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706368 00000100:00100000:1.0:1786960651.576382:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706368 00000100:00100000:1.0:1786960651.576398:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786960651.576521:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706368:12345-0@lo:503: 00000100:00100000:1.0:1786960651.576668:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706368:12345-0@lo:503: Request processed in 263us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960651.576718:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706368:0@lo:503: 00000100:00100000:1.0:1786960651.578132:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786960651.581140:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7097:1873763967706496:0@lo:502: 00000100:00100000:3.0:1786960651.581259:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.581315:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648cb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.581801:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706496 00000100:00100000:1.0:1786960651.581810:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706496 00000100:00100000:1.0:1786960651.581869:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786960651.581879:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7097:x1873763967706496:12345-0@lo:502: 00000100:00100000:1.0:1786960651.582274:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7097:x1873763967706496:12345-0@lo:502: Request processed in 395us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960651.582282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786960651.582499:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7097:1873763967706496:0@lo:502: 00000100:00100000:3.0:1786960651.582670:0:7097:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7097:1873763967706624:0@lo:502: 00000100:00100000:3.0:1786960651.582783:0:7097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.582821:0:7097:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648cb3240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.582823:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706624 00000100:00100000:1.0:1786960651.582830:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706624 00000100:00100000:1.0:1786960651.582867:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786960651.582886:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7097:x1873763967706624:12345-0@lo:502: 00000100:00100000:1.0:1786960651.583215:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7097:x1873763967706624:12345-0@lo:502: Request processed in 332us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960651.583223:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786960651.586264:0:7097:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7097:1873763967706624:0@lo:502: 00000040:00080000:3.0:1786960651.586342:0:7097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1786960651.586507:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1786960651.586531:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786960651.586543:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.586555:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960651.586566:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786960651.586569:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff976652341800 from 4 10000000:01000000:1.0:1786960651.586573:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786960651.586619:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.586627:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.586638:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960651.586662:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706752:0@lo:101: 00000100:00100000:1.0:1786960651.586732:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.586782:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706752 00000100:00100000:3.0:1786960651.586793:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706752 00000100:00100000:3.0:1786960651.586870:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786960651.586879:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967706752:12345-0@lo:101: 00010000:00010000:3.0:1786960651.586893:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960651.586909:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f377 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.586933:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.586944:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.586954:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168400, rc 0) 00000100:00100000:3.0:1786960651.586988:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967706752:12345-0@lo:101: Request processed in 110us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.586995:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960651.587554:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976654b0d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.587578:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706752:0@lo:101: 00010000:00010000:1.0:1786960651.587593:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.587618:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960651.587669:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706880:0@lo:256: 00000100:00100000:1.0:1786960651.587729:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.587765:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976654b0d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960651.587867:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967706880 00000100:00100000:0.0:1786960651.587873:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967706880 00000100:00100000:0.0:1786960651.587909:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786960651.587918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967706880:12345-0@lo:256: 20000000:01000000:0.0:1786960651.587937:0:5803:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786960651.587955:0:5803:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786960651.587958:0:5803:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1786960651.588053:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967706880:12345-0@lo:256: Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960651.588062:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786960651.588084:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967706880:0@lo:256: 10000000:01000000:1.0:1786960651.588130:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786960651.588137:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.588147:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960651.588156:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786960651.588158:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1786960651.588161:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786960651.588179:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.588205:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.588215:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960651.588230:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707008:0@lo:101: 00000100:00100000:1.0:1786960651.588262:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.588329:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707008 00000100:00100000:3.0:1786960651.588335:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707008 00000100:00100000:3.0:1786960651.588361:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786960651.588399:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967707008:12345-0@lo:101: 00010000:00010000:3.0:1786960651.588468:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960651.588485:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f385 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.588504:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.588514:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.588521:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169400, rc 0) 00000100:00100000:3.0:1786960651.588546:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967707008:12345-0@lo:101: Request processed in 150us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.588553:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786960651.588608:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960651.588624:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707008:0@lo:101: 00010000:00010000:1.0:1786960651.588634:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960651.588643:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960651.588686:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707136:0@lo:501: 00000100:00100000:1.0:1786960651.588711:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.588731:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.588753:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707136 00000100:00100000:3.0:1786960651.588759:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707136 00000100:00100000:3.0:1786960651.588787:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786960651.588794:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967707136:12345-0@lo:501: 00000100:00100000:3.0:1786960651.589154:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967707136:12345-0@lo:501: Request processed in 360us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.589162:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786960651.589183:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707136:0@lo:501: 00000100:00100000:1.0:1786960651.589238:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707264:0@lo:503: 00000100:00100000:1.0:1786960651.589279:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.589293:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.589893:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707264 00000100:00100000:3.0:1786960651.589900:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707264 00000100:00100000:3.0:1786960651.589940:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786960651.589948:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967707264:12345-0@lo:503: 00000100:00100000:3.0:1786960651.592127:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967707264:12345-0@lo:503: Request processed in 2169us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.592152:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786960651.593309:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967707264:0@lo:503: 00000100:00100000:1.0:1786960651.593711:0:7098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7098:1873763967707392:0@lo:502: 00000100:00100000:1.0:1786960651.593803:0:7098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.593846:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707392 00000100:00100000:3.0:1786960651.593854:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707392 00000100:00100000:1.0:1786960651.593863:0:7098:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.593900:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786960651.593910:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:7098:x1873763967707392:12345-0@lo:502: 00000100:00100000:3.0:1786960651.594269:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:7098:x1873763967707392:12345-0@lo:502: Request processed in 359us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.594277:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786960651.595958:0:7098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7098:1873763967707392:0@lo:502: 00000020:01000000:1.0:1786960651.596007:0:7098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786960651.596032:0:7098:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1786960651.596043:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960651.596045:0:7098:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1786960651.596053:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1786960651.596065:0:7098:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:1.0:1786960651.596112:0:7098:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1786960651.596117:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786960651.596160:0:7098:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97664e7f0000) 00000020:00000080:1.0:1786960651.596218:0:7098:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1786960651.596227:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1786960651.596378:0:7098:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1786960651.596384:0:7098:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1786960651.596404:0:7098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f39a 00010000:00080000:1.0:1786960651.596442:0:7098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff976677706800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1786960651.596710:0:7098:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1786960651.649225:0:7098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1786960651.649256:0:7098:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786960651.649973:0:7098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960651.650146:0:7098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960651.650248:0:7098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1786960651.650344:0:7098:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1786960651.651535:0:7102:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960651.651542:0:7102:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786960651.652265:0:7098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786960651.652281:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786960651.652331:0:7098:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786960651.652358:0:7098:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c97f3a1 00000100:00080000:2.0:1786960651.652370:0:7098:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786960651.652378:0:7098:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff976677706800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960651.652415:0:7098:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97666b4b9500 x1873763967707520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786960651.652454:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967707520:0@lo:8: 00000100:00100000:2.0:1786960651.652540:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786960651.652613:0:7098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786960651.652685:0:7098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960651.652690:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960651.652692:0:7098:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786960651.652696:0:7098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960651.652702:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960651.652703:0:7098:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960651.652706:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960651.652708:0:7098:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786960651.652737:0:7098:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7098:1873763967707648:0@lo:502: 00000100:00100000:2.0:1786960651.652787:0:7098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960651.652806:0:7098:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.653101:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707520 00000100:00100000:3.0:1786960651.653110:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707520 00000100:00100000:3.0:1786960651.653148:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960651.653157:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967707520:12345-0@lo:8: 00010000:00080000:3.0:1786960651.653182:0:6658:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 133 last 0 00000020:00000080:3.0:1786960651.653240:0:6658:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c97f3a8 00002000:00100000:3.0:1786960651.653277:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97667a86b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1786960651.653282:0:6658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1786960651.653286:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1786960651.653553:0:6658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786960651.653700:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1786960651.653728:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667a86b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960651.653806:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1873763967707520:12345-0@lo:8: Request processed in 649us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.653813:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960651.653899:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707648 00000100:00100000:3.0:1786960651.653904:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707648 00000100:00100000:3.0:1786960651.653932:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786960651.653940:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:7098:x1873763967707648:12345-0@lo:502: 00010000:00080000:0.0:1786960651.654135:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4b9500 x1873763967707520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786960661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960651.654148:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786960651.654156:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786960651.654164:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786960651.654169:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1786960651.654172:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976677706800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786960651.654182:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786960651.654254:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967707520:0@lo:8: 00000100:00100000:3.0:1786960651.654491:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:7098:x1873763967707648:12345-0@lo:502: Request processed in 551us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.654499:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786960651.654553:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967707776:0@lo:400: 00000100:00100000:3.0:1786960651.654595:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.654873:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967707904:0@lo:400: 00000100:00100000:3.0:1786960651.654904:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.654952:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707776 00000100:00100000:3.0:1786960651.654959:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707776 00000100:00100000:3.0:1786960651.654992:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967707904 00000100:00100000:3.0:1786960651.654996:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967707904 00000100:00100000:3.0:1786960651.655023:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960651.655032:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967707776:12345-0@lo:400: 00000100:00100000:3.0:1786960651.655092:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967707776:12345-0@lo:400: Request processed in 62us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.655099:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960651.655115:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960651.655123:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967707904:12345-0@lo:400: 00000100:00100000:3.0:1786960651.655160:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967707904:12345-0@lo:400: Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.655166:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1786960651.655220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786960651.655246:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667a69f480 x1873763967707776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960651.655257:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967707776:0@lo:400: 00010000:00080000:3.0:1786960651.655284:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667a69c700 x1873763967707904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960651.655367:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967707904:0@lo:400: 00000100:00100000:3.0:1786960651.655396:0:7098:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:7098:1873763967707648:0@lo:502: 00000020:01000000:3.0:1786960651.655428:0:7098:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960651.655436:0:7098:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960651.655438:0:7098:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1786960651.655444:0:7098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1786960651.655509:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1786960651.655526:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786960651.655536:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655547:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960651.655558:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1786960651.655561:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97664e5c8000 from 1 10000000:01000000:3.0:1786960651.655564:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786960651.655596:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655604:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655614:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960651.655630:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967708032:0@lo:101: 00000100:00100000:3.0:1786960651.655666:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.655689:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b4203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.655703:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708032 00000100:00100000:3.0:1786960651.655707:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708032 00000100:00100000:3.0:1786960651.655727:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786960651.655733:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967708032:12345-0@lo:101: 00010000:00010000:3.0:1786960651.655742:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960651.655755:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f3af expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655777:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655786:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655794:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168c00, rc 0) 00000100:00100000:3.0:1786960651.655822:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967708032:12345-0@lo:101: Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960651.655828:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786960651.655863:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967708032:0@lo:101: 00010000:00010000:3.0:1786960651.655875:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.655885:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960651.655928:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967708160:0@lo:501: 00000100:00100000:3.0:1786960651.655953:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960651.655968:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b4203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960651.655986:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708160 00000100:00100000:3.0:1786960651.655990:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708160 00000100:00100000:3.0:1786960651.656015:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786960651.656023:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967708160:12345-0@lo:501: 00000004:00080000:1.0:1786960651.656257:0:7102:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786960651.656406:0:7102:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 133683218467ns, next at 0ns, rc = 0 00000100:00100000:3.0:1786960651.658450:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967708160:12345-0@lo:501: Request processed in 2417us (2485us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960651.658466:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786960651.658553:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967708160:0@lo:501: 10000000:01000000:3.0:1786960651.658593:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786960651.658603:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960651.658614:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960651.715505:0:6674:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1786960651.822342:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967708288:0@lo:13: 00000100:00100000:3.0:1786960651.822416:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960651.822541:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708288 00000100:00100000:2.0:1786960651.822551:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708288 00000100:00100000:2.0:1786960651.822607:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960651.822618:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967708288:12345-0@lo:13: 00002000:00000024:2.0:1786960651.822651:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:0.0:1786960651.822765:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1786960651.822869:0:7103:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1786960651.822893:0:7103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708416:0@lo:7: 00000100:00100000:2.0:1786960651.828660:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967708288:12345-0@lo:13: Request processed in 6037us (6237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960651.828675:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786960651.828787:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97664e74f100 x1873763967708288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960651.828810:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967708288:0@lo:13: 00000100:00100000:1.0:1786960651.837234:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.837290:0:7103:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960651.837413:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708416 00000100:00100000:2.0:1786960651.837424:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708416 00000100:00100000:2.0:1786960651.837487:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960651.837496:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7103:x1873763967708416:12345-0@lo:7: 00002000:00080000:2.0:1786960651.844937:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1786960651.844945:0:6660:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1786960651.845042:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7103:x1873763967708416:12345-0@lo:7: Request processed in 7542us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960651.845053:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786960651.845160:0:7103:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97664e74fb80 x1873763967708416/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786960667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960651.845176:0:7103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708416:0@lo:7: 00000004:00080000:1.0:1786960651.845215:0:7103:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1786960651.845266:0:7103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708544:0@lo:5: 00000100:00100000:1.0:1786960651.845302:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960651.845343:0:7103:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960651.845796:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708544 00000100:00100000:2.0:1786960651.845804:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708544 00000100:00100000:2.0:1786960651.845851:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960651.845860:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7103:x1873763967708544:12345-0@lo:5: 00002000:00080000:2.0:1786960651.845887:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1786960651.845890:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1786960651.846133:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7103:x1873763967708544:12345-0@lo:5: Request processed in 273us (829us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1786960651.846139:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786960651.846176:0:7103:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97664e74fb80 x1873763967708544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786960667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960651.846227:0:7103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708544:0@lo:5: 00000004:00080000:2.0:1786960651.846238:0:7103:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1786960651.846264:0:7103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708672:0@lo:700: 00000100:00100000:2.0:1786960651.846293:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960651.846313:0:7103:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960651.846332:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708672 00000100:00100000:2.0:1786960651.846335:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708672 00000100:00100000:2.0:1786960651.846359:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960651.846366:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7103:x1873763967708672:12345-0@lo:700: 00000100:00100000:2.0:1786960651.846393:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6666:1873763967708800:0@lo:700: 00000100:00100000:2.0:1786960651.846420:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960651.846597:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960651.846622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708800 00000100:00100000:2.0:1786960651.846626:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708800 00000100:00100000:2.0:1786960651.846695:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960651.846703:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6666:x1873763967708800:12345-0@lo:700: 40000000:02000000:2.0:1786960651.930526:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1786960651.945543:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6666:x1873763967708800:12345-0@lo:700: Request processed in 98833us (99113us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960651.945556:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786960651.945773:0:6666:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4b8000 x1873763967708800/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786960667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960651.945789:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6666:1873763967708800:0@lo:700: 40000000:02000000:3.0:1786960651.945802:0:6666:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1786960652.044511:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7103:x1873763967708672:12345-0@lo:700: Request processed in 198060us (198132us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960652.044547:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1786960652.044698:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1786960652.044723:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1786960652.044766:0:7103:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4bb480 x1873763967708672/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786960667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960652.044794:0:7103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708672:0@lo:700: 00000004:02000040:2.0:1786960652.131090:0:7103:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1786960652.142563:0:7103:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708928:0@lo:5: 00000100:00100000:2.0:1786960652.142633:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960652.142689:0:7103:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960652.142772:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967708928 00000100:00100000:0.0:1786960652.142787:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967708928 00000100:00100000:0.0:1786960652.142846:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960652.142857:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7103:x1873763967708928:12345-0@lo:5: 00002000:00080000:0.0:1786960652.155181:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1786960652.155225:0:6660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1786960652.164642:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7103:x1873763967708928:12345-0@lo:5: Request processed in 21780us (22001us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786960652.164656:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786960652.165768:0:7103:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4bb480 x1873763967708928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786960668 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960652.165783:0:7103:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1786960652.165801:0:7103:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97666b4bb480 x1873763967708928/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786960668 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960652.165813:0:7103:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7103:1873763967708928:0@lo:5: 00000004:00080000:1.0:1786960652.165828:0:7103:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1786960652.470934:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960653.497835:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960654.516903:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786960655.363737:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1786960655.541856:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960656.564335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960656.701116:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967709056:0@lo:400: 00000100:00100000:0.0:1786960656.701208:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960656.701261:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960656.701267:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967709184:0@lo:400: 00000100:00100000:0.0:1786960656.701291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960656.701321:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967709312:0@lo:400: 00000100:00100000:0.0:1786960656.701344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960656.701361:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960656.701366:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967709440:0@lo:400: 00000100:00100000:0.0:1786960656.701387:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960656.701417:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709056 00000100:00100000:0.0:1786960656.701425:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709056 00000100:00100000:0.0:1786960656.701469:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786960656.701478:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3287:x1873763967709056:12345-0@lo:400: 00000100:00100000:0.0:1786960656.701532:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3287:x1873763967709056:12345-0@lo:400: Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960656.701539:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786960656.701580:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709184 00000100:00100000:0.0:1786960656.701584:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709184 00000100:00100000:0.0:1786960656.701606:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709312 00000100:00100000:0.0:1786960656.701608:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709312 00000100:00100000:0.0:1786960656.701629:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960656.701635:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967709184:12345-0@lo:400: 00000100:00100000:0.0:1786960656.701667:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967709184:12345-0@lo:400: Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960656.701673:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960656.701684:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960656.701689:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967709312:12345-0@lo:400: 00000100:00100000:0.0:1786960656.701716:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967709312:12345-0@lo:400: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960656.701721:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960656.701740:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709440 00000100:00100000:0.0:1786960656.701743:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709440 00000100:00100000:0.0:1786960656.701765:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786960656.701770:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967709440:12345-0@lo:400: 00000100:00100000:0.0:1786960656.701794:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967709440:12345-0@lo:400: Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960656.701799:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786960656.701830:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad1c00 x1873763967709184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960656.701844:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967709184:0@lo:400: 00000100:00100000:0.0:1786960656.701852:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967709056:0@lo:400: 00000100:00080000:0.0:1786960656.701876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960656.701881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786960656.701904:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad2300 x1873763967709440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960656.701912:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1786960656.701921:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967709440:0@lo:400: 00010000:00080000:0.0:1786960656.701930:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad1f80 x1873763967709312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960656.701939:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967709312:0@lo:400: 00000100:00100000:0.0:1786960657.208710:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967709568:0@lo:13: 00000100:00100000:0.0:1786960657.208782:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960657.208879:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709568 00000100:00100000:0.0:1786960657.208887:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709568 00000100:00100000:0.0:1786960657.208945:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786960657.208956:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967709568:12345-0@lo:13: 00002000:00000024:0.0:1786960657.208991:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960657.209048:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967709568:12345-0@lo:13: Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960657.209055:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786960657.209091:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad1f80 x1873763967709568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960657.209108:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967709568:0@lo:13: 00010000:00010000:0.0:1786960657.588979:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960658.612296:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960659.636700:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960660.660349:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960661.684396:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960661.815530:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967710080:0@lo:400: 00000100:00100000:3.0:1786960661.815612:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960661.815692:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960661.815701:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967709696:0@lo:400: 00000100:00100000:3.0:1786960661.815738:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960661.815781:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967709824:0@lo:400: 00000100:00100000:3.0:1786960661.816111:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960661.816140:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786960661.816146:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967709952:0@lo:400: 00000100:00100000:3.0:1786960661.816173:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960661.816175:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709824 00000100:00100000:2.0:1786960661.816213:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709824 00000100:00100000:3.0:1786960661.816247:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710080 00000100:00100000:3.0:1786960661.816254:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710080 00000100:00100000:2.0:1786960661.816288:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709952 00000100:00100000:2.0:1786960661.816294:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709952 00000100:00100000:3.0:1786960661.816324:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960661.816332:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786960661.816338:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967710080:12345-0@lo:400: 00000100:00100000:2.0:1786960661.816347:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967709824:12345-0@lo:400: 00000100:00100000:3.0:1786960661.816397:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967710080:12345-0@lo:400: Request processed in 63us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960661.816406:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960661.816440:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967709696 00000100:00100000:3.0:1786960661.816444:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967709696 00000100:00100000:2.0:1786960661.816456:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967709824:12345-0@lo:400: Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960661.816465:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786960661.816482:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786960661.816491:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786960661.816493:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3287:x1873763967709696:12345-0@lo:400: 00000100:00100000:2.0:1786960661.816506:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967709952:12345-0@lo:400: 00000100:00100000:3.0:1786960661.816548:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3287:x1873763967709696:12345-0@lo:400: Request processed in 56us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960661.816564:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967709952:12345-0@lo:400: Request processed in 61us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960661.816575:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786960661.816579:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1786960661.816629:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786960661.816635:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786960661.816669:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667a69f800 x1873763967709952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960661.816685:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967709952:0@lo:400: 00010000:00080000:3.0:1786960661.816696:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667a69ca80 x1873763967709824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960661.816705:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967709824:0@lo:400: 00000100:00100000:3.0:1786960661.816731:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967709696:0@lo:400: 00010000:00080000:3.0:1786960661.816740:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667a69d180 x1873763967710080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960661.816749:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967710080:0@lo:400: 00000020:01000004:3.0:1786960662.090612:0:7599:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786960662.090616:0:7599:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1786960662.090758:0:7599:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9766772e6000 00000020:01000004:3.0:1786960662.090775:0:7599:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1786960662.091133:0:7599:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1786960662.091148:0:7599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97667a6e99c0) 00000020:00000080:3.0:1786960662.091167:0:7599:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1786960662.122955:0:7599:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1786960662.123288:0:7599:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1786960662.156154:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1786960662.172328:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786960662.172372:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1786960662.172432:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786960662.172457:0:7599:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1786960662.177600:0:7599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1786960662.177618:0:7599:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786960662.177633:0:7599:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1808d16e4c97f3c4 00000020:01000004:2.0:1786960662.177643:0:7599:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1786960662.177680:0:7599:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786960662.177685:0:7599:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786960662.177691:0:7599:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1786960662.177717:0:7599:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1786960662.177722:0:7599:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1786960662.212717:0:7599:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786960662.212769:0:7599:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1786960662.212774:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786960662.212776:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786960662.212778:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960662.212779:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960662.212781:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960662.212785:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960662.212786:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786960662.212788:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786960662.212789:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786960662.212791:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960662.212792:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960662.212797:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1786960662.212799:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786960662.212800:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786960662.212801:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960662.212802:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960662.212803:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960662.212804:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960662.212805:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786960662.212806:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786960662.212807:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786960662.212808:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960662.212809:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960662.212929:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1786960662.212955:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967710208:0@lo:253: 00000100:00100000:3.0:1786960662.213052:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960662.213118:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960662.213248:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710208 00000100:00100000:0.0:1786960662.213257:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710208 00000100:00100000:0.0:1786960662.213306:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786960662.213328:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:7599:x1873763967710208:12345-0@lo:253: 20000000:01000000:0.0:1786960662.213370:0:5804:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1786960662.213374:0:5804:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1786960662.213380:0:5804:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1786960662.213385:0:5804:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1786960662.214371:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786960662.214582:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1786960662.214597:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1786960662.214631:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1786960662.214638:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1786960662.214664:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1786960662.214704:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1786960662.215052:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1786960662.215071:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:0.0:1786960662.215073:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1786960662.215102:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1786960662.215109:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1786960662.215147:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1786960662.215156:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1786960662.215183:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1786960662.215219:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1786960662.215247:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1786960662.215302:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1786960662.216046:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1786960662.216063:0:5804:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.123@tcp 20000000:01000000:0.0:1786960662.216065:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.123@tcp (null) (null) (null) 00000040:00080000:0.0:1786960662.216094:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1786960662.216100:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1786960662.216125:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1786960662.216131:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.123@tcp (null) (null) 00000040:00080000:0.0:1786960662.216156:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1786960662.216163:0:5804:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1786960662.218648:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1786960662.218909:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1786960662.218941:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1786960662.218944:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1786960662.218951:0:5804:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1786960662.218953:0:5804:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1786960662.218955:0:5804:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1786960662.218970:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786960662.218973:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1786960662.219038:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1786960662.219041:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786960662.220260:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1786960662.220560:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1786960662.220602:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1786960662.220732:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1786960662.220745:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1786960662.220748:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786960662.225269:0:7602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1786960662.225374:0:7602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1786960662.225423:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1786960662.225936:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1786960662.225992:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1786960662.226044:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1786960662.226059:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1786960662.226062:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786960662.230649:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1786960662.230820:0:7603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1786960662.230903:0:7603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1786960662.234252:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1786960662.234306:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1786960662.234382:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1786960662.234400:0:5804:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1786960662.234403:0:5804:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1786960662.236407:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1786960662.236506:0:7604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1786960662.236536:0:7604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1786960662.237127:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1786960662.237795:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1786960662.237948:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1786960662.237974:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1786960662.237995:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238025:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238034:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238042:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238050:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238069:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238078:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238120:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238134:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 16 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.238152:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710336:0@lo:104: 00000100:00100000:2.0:1786960662.238786:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960662.238893:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238903:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 16 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.238913:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710464:0@lo:104: 00010000:00010000:2.0:1786960662.238936:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.238944:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 16 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.238952:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710592:0@lo:104: 00010000:00010000:2.0:1786960662.238988:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.239011:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 16 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.239020:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710720:0@lo:104: 00010000:00010000:2.0:1786960662.239054:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.239062:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 16 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.239070:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710848:0@lo:104: 00000100:00100000:2.0:1786960662.239086:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42240 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.246312:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786960662.246370:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.246450:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.248164:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.248833:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710336 00000100:00100000:0.0:1786960662.248853:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710336 00000100:00100000:0.0:1786960662.248900:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710464 00000100:00100000:0.0:1786960662.248903:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710464 00000100:00100000:0.0:1786960662.248912:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710592 00000100:00100000:0.0:1786960662.248931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710592 00000100:00100000:0.0:1786960662.248948:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960662.248957:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:5804:x1873763967710336:12345-0@lo:104: 00010000:00010000:0.0:1786960662.248975:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.249550:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786960662.249559:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e6b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:5804:x1873763967710336:12345-0@lo:104: Request processed in 602us (10774us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.249567:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960662.249613:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960662.249619:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:5804:x1873763967710464:12345-0@lo:104: 00010000:00010000:0.0:1786960662.249628:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.249773:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710336:0@lo:104: 00000100:00100000:3.0:1786960662.249783:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710464:0@lo:104: 00010000:00010000:0.0:1786960662.249817:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786960662.249823:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:5804:x1873763967710464:12345-0@lo:104: Request processed in 204us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.249830:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960662.249892:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786960662.249899:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5804:x1873763967710592:12345-0@lo:104: 00010000:00010000:0.0:1786960662.249907:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.249974:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786960662.249979:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5804:x1873763967710592:12345-0@lo:104: Request processed in 82us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.249985:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1786960662.250028:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786960662.250035:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250043:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:0.0:1786960662.250048:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250058:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960662.250067:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960662.250073:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786960662.250108:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250114:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786960662.250134:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250142:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f3af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3b6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250168:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786960662.250171:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250177:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:0.0:1786960662.250180:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250211:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960662.250218:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960662.250223:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786960662.250236:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250240:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786960662.250254:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250261:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169a200/0x1808d16e4c97f385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f38c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250271:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960662.250274:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250280:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:0.0:1786960662.250283:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250290:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960662.250297:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960662.250307:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1786960662.250318:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250324:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786960662.250329:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250335:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169a000/0x1808d16e4c97f369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f370 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250343:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960662.250345:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960662.250347:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960662.250353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960662.250374:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967710976:0@lo:103: 00000100:00100000:0.0:1786960662.250416:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.250469:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967711104:0@lo:103: 00000100:00100000:0.0:1786960662.250489:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.250506:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960662.250510:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967711232:0@lo:103: 00000100:00100000:0.0:1786960662.250526:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.250553:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710976 00000100:00100000:0.0:1786960662.250559:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710976 00010000:00010000:0.0:1786960662.250577:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 17 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.250596:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711104 00000100:00100000:0.0:1786960662.250603:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711104 00010000:00010000:0.0:1786960662.250614:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 18 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.250624:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711232 00000100:00100000:0.0:1786960662.250626:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711232 00010000:00010000:0.0:1786960662.250635:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 19 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.250646:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960662.250651:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967710976:12345-0@lo:103: 00010000:00010000:0.0:1786960662.250672:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960662.250678:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 19 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250690:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 19 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250707:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168c00/0x1808d16e4c97f3b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f3af expref: 19 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250721:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960662.250746:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3288:x1873763967710976:12345-0@lo:103: Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.250752:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960662.250763:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960662.250768:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:3285:x1873763967711104:12345-0@lo:103: 00010000:00010000:0.0:1786960662.250775:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960662.250779:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 17 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250798:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 17 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250807:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169400/0x1808d16e4c97f38c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f385 expref: 17 pid: 5804 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250822:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960662.250856:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3285:x1873763967711104:12345-0@lo:103: Request processed in 88us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.250862:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960662.250875:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786960662.250881:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3285:x1873763967711232:12345-0@lo:103: 00010000:00010000:0.0:1786960662.250887:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960662.250891:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250899:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.250908:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960662.250924:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3285:x1873763967711232:12345-0@lo:103: Request processed in 44us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.250930:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786960662.250963:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967711232:0@lo:103: 00000100:00100000:0.0:1786960662.250971:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967711104:0@lo:103: 00000100:00100000:0.0:1786960662.250993:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967710976:0@lo:103: 00000100:00100000:2.0:1786960662.251367:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.251383:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710720 00000100:00100000:2.0:1786960662.251386:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710720 00000100:00100000:2.0:1786960662.251423:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967710848 00000100:00100000:2.0:1786960662.251426:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967710848 00000100:00100000:2.0:1786960662.251438:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960662.251443:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+4:5804:x1873763967710720:12345-0@lo:104: 00010000:00010000:2.0:1786960662.251453:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.251487:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960662.251492:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+4:5804:x1873763967710720:12345-0@lo:104: Request processed in 50us (3336us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.251503:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960662.251515:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960662.251521:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5804:x1873763967710848:12345-0@lo:104: 00010000:00010000:2.0:1786960662.251528:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.251554:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786960662.251559:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5804:x1873763967710848:12345-0@lo:104: Request processed in 39us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.251565:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1786960662.251623:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786960662.251629:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251637:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960662.251640:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251649:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960662.251656:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960662.251670:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960662.251699:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251711:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960662.251721:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251728:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f33f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f346 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251739:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960662.251742:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251748:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960662.251751:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251757:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960662.251764:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960662.251770:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960662.251780:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251786:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960662.251790:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251796:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169a800/0x1808d16e4c97f315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f31c expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.251813:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960662.251814:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960662.251816:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960662.251976:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967711360:0@lo:103: 00000100:00100000:0.0:1786960662.252058:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.252126:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960662.252132:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967711488:0@lo:103: 00000100:00100000:0.0:1786960662.252150:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960662.252222:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168800/0x1808d16e4c97f370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f369 expref: 14 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.252240:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710592:0@lo:104: 00010000:00010000:1.0:1786960662.252328:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960662.252502:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710720:0@lo:104: 00000100:00100000:0.0:1786960662.252510:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5804:1873763967710848:0@lo:104: 00010000:00010000:0.0:1786960662.252537:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960662.252606:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711360 00000100:00100000:2.0:1786960662.252611:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711360 00010000:00010000:0.0:1786960662.252723:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 14 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.252772:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711488 00000100:00100000:0.0:1786960662.252775:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711488 00010000:00010000:0.0:1786960662.252786:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 15 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.252812:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786960662.252821:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3287:x1873763967711360:12345-0@lo:103: 00010000:00010000:3.0:1786960662.252830:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960662.252836:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252855:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252868:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f33f expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252878:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960662.252916:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:3287:x1873763967711360:12345-0@lo:103: Request processed in 97us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.252923:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786960662.252937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786960662.252942:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3287:x1873763967711488:12345-0@lo:103: 00010000:00010000:3.0:1786960662.252949:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960662.252953:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 13 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252962:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 13 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252972:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169000/0x1808d16e4c97f31c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f315 expref: 13 pid: 5803 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.252988:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253019:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253034:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253043:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253049:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253056:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253062:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960662.253066:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253074:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253087:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.253095:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960662.253116:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3287:x1873763967711488:12345-0@lo:103: Request processed in 173us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.253122:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960662.253173:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967711488:0@lo:103: 00000100:00100000:2.0:1786960662.253181:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967711360:0@lo:103: 00010000:00010000:0.0:1786960662.253504:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.253512:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.253519:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045a00/0x1808d16e4c97f3cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786960662.253533:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1786960662.307388:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:7599:x1873763967710208:12345-0@lo:253: Request processed in 94049us (94323us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.307418:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786960662.307573:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967710208:0@lo:253: 10000000:01000000:0.0:1786960662.307597:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786960662.307601:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786960662.307603:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786960662.307604:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960662.307605:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1786960662.307607:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960662.307608:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960662.307610:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960662.307611:0:7599:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1786960662.307613:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960662.307615:0:7599:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786960662.307636:0:7599:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9766772e6000 from lustre-OST0001 10000000:01000000:0.0:1786960662.307672:0:7599:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786960662.307676:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786960662.307684:0:7599:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97664e5c8000 local copy 10000000:01000000:0.0:1786960662.307689:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786960662.307727:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.307739:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.307749:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.307769:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711616:0@lo:101: 00000100:00100000:0.0:1786960662.307804:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.308112:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.308178:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711616 00000100:00100000:3.0:1786960662.308335:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711616 00000100:00100000:2.0:1786960662.308508:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786960662.308518:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+11:7599:x1873763967711616:12345-0@lo:101: 00010000:00010000:2.0:1786960662.308531:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960662.308546:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045000/0x1808d16e4c97f3d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f3d2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.308571:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045000/0x1808d16e4c97f3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f3d2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.308582:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045000/0x1808d16e4c97f3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3d2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960662.308591:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:2.0:1786960662.308642:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967711616:12345-0@lo:101: Request processed in 126us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.308649:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786960662.308746:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711616:0@lo:101: 00010000:00010000:0.0:1786960662.308759:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.308778:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.308899:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711744:0@lo:501: 00000100:00100000:0.0:1786960662.308925:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.309417:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.309481:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711744 00000100:00100000:2.0:1786960662.309485:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711744 00000100:00100000:1.0:1786960662.309516:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786960662.309527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967711744:12345-0@lo:501: 00000100:00100000:1.0:1786960662.312463:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967711744:12345-0@lo:501: Request processed in 2927us (3525us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786960662.312479:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786960662.312563:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711744:0@lo:501: 10000000:01000000:1.0:1786960662.312590:0:7599:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786960662.312629:0:7599:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786960662.312637:0:7599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.312649:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.312657:0:7599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.314876:0:7599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786960662.314911:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9766772e6000 10000000:01000000:0.0:1786960662.314918:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786960662.314924:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786960662.314927:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786960662.314945:0:7599:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1786960662.314948:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786960662.314991:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.315011:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.315022:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.315050:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711872:0@lo:101: 00000100:00100000:0.0:1786960662.315114:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960662.315208:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960662.315217:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315225:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960662.315403:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315413:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960662.315421:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960662.315427:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786960662.315448:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315454:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960662.315476:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315483:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f3d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1808d16e4c97f3d9 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315497:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960662.315499:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960662.315515:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960662.315529:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967712000:0@lo:103: 00000100:00100000:3.0:1786960662.315559:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960662.315626:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712000 00000100:00100000:3.0:1786960662.315633:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712000 00000100:00100000:3.0:1786960662.315686:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960662.315695:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3285:x1873763967712000:12345-0@lo:103: 00010000:00010000:3.0:1786960662.315708:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960662.315722:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045000/0x1808d16e4c97f3d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f3d2 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.315738:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960662.315767:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+11:3285:x1873763967712000:12345-0@lo:103: Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.315774:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960662.315810:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967712000:0@lo:103: 00000100:00100000:0.0:1786960662.316330:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.316548:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967711872 00000100:00100000:1.0:1786960662.316553:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967711872 00000100:00100000:1.0:1786960662.316583:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786960662.316590:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+11:7599:x1873763967711872:12345-0@lo:101: 00010000:00010000:1.0:1786960662.316603:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960662.316625:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f3e0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.316645:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.316656:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.316674:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a800, rc 0) 00000100:00100000:1.0:1786960662.316717:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967711872:12345-0@lo:101: Request processed in 127us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.316724:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786960662.316840:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967711872:0@lo:101: 00010000:00010000:0.0:1786960662.316856:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.316871:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.317011:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712128:0@lo:501: 00000100:00100000:0.0:1786960662.317039:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.317066:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.317180:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712128 00000100:00100000:1.0:1786960662.317208:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712128 00000100:00100000:1.0:1786960662.317281:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786960662.317289:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712128:12345-0@lo:501: 00000100:00100000:1.0:1786960662.317539:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712128:12345-0@lo:501: Request processed in 251us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.317546:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786960662.317630:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712128:0@lo:501: 00000100:00100000:0.0:1786960662.317668:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712256:0@lo:503: 00000100:00100000:0.0:1786960662.317703:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.317721:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.317818:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712256 00000100:00100000:1.0:1786960662.317822:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712256 00000100:00100000:1.0:1786960662.317839:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786960662.317844:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712256:12345-0@lo:503: 00000100:00100000:1.0:1786960662.318435:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712256:12345-0@lo:503: Request processed in 588us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.318442:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786960662.318631:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712256:0@lo:503: 00000040:00080000:0.0:1786960662.319093:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960662.319157:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712384:0@lo:502: 00000100:00100000:0.0:1786960662.319217:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.319334:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.319387:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712384 00000100:00100000:3.0:1786960662.319393:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712384 00000100:00100000:1.0:1786960662.319597:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1786960662.319606:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712384:12345-0@lo:502: 00000100:00100000:1.0:1786960662.320150:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712384:12345-0@lo:502: Request processed in 544us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.320157:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786960662.320366:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712384:0@lo:502: 00000040:00080000:0.0:1786960662.320624:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786960662.320731:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1786960662.320765:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1786960662.320806:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1786960662.320836:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1786960662.320863:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1786960662.320889:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712512:0@lo:502: 00000100:00100000:0.0:1786960662.320928:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.321148:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.321338:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712512 00000100:00100000:3.0:1786960662.321345:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712512 00000100:00100000:3.0:1786960662.321383:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786960662.321391:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712512:12345-0@lo:502: 00000100:00100000:3.0:1786960662.321555:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712512:12345-0@lo:502: Request processed in 163us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.321562:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786960662.321722:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712512:0@lo:502: 00000040:00080000:0.0:1786960662.321813:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1786960662.321824:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1786960662.322651:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786960662.322720:0:7606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1786960662.322728:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960662.322730:0:7606:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1786960662.322736:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786960662.322754:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97664e7f19c0) 00000020:00000080:1.0:1786960662.322784:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786960662.322790:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786960662.322857:0:7606:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766772e6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1786960662.322866:0:7606:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786960662.322872:0:7606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1808d16e4c97f3f5 00000100:00100000:3.0:1786960662.326862:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967712640:0@lo:13: 00000100:00100000:3.0:1786960662.326954:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.327067:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712640 00000100:00100000:1.0:1786960662.327076:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712640 00000100:00100000:1.0:1786960662.327131:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786960662.327140:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967712640:12345-0@lo:13: 00002000:00000024:1.0:1786960662.327178:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00010000:0.0:1786960662.328610:0:7606:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1786960662.329156:0:7606:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000100:00100000:1.0:1786960662.330163:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967712640:12345-0@lo:13: Request processed in 3017us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.330176:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1786960662.330322:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4ba680 x1873763967712640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960662.330350:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967712640:0@lo:13: 00000001:00000004:0.0:1786960662.332080:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1786960662.332566:0:7606:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1786960662.344990:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1786960662.347697:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1786960662.351995:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1786960662.352019:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960662.352026:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960662.352029:0:7606:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1786960662.352047:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960662.352051:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960662.352053:0:7606:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786960662.352056:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786960662.352058:0:7606:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786960662.352128:0:7606:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960662.352131:0:7606:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960662.352132:0:7606:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1786960662.352136:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1786960662.352508:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1786960662.352541:0:7599:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786960662.352565:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.352579:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960662.352605:0:7599:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e6000 from 1 10000000:01000000:1.0:1786960662.352608:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960662.352646:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.352654:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.352775:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960662.352802:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712768:0@lo:101: 00000100:00100000:1.0:1786960662.352881:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.352928:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.353133:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712768 00000100:00100000:3.0:1786960662.353140:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712768 00000100:00100000:3.0:1786960662.353255:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786960662.353265:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+12:7599:x1873763967712768:12345-0@lo:101: 00010000:00010000:3.0:1786960662.353279:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960662.353292:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f3fc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.353314:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.353325:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.353334:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169000, rc 0) 00000100:00100000:3.0:1786960662.353377:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967712768:12345-0@lo:101: Request processed in 113us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.353384:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786960662.353460:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712768:0@lo:101: 00010000:00010000:1.0:1786960662.353475:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.353484:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960662.353575:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712896:0@lo:501: 00000100:00100000:1.0:1786960662.353598:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.360469:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.360636:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967712896 00000100:00100000:2.0:1786960662.360647:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967712896 00000100:00100000:2.0:1786960662.360713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786960662.360722:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967712896:12345-0@lo:501: 00000100:00100000:2.0:1786960662.365847:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967712896:12345-0@lo:501: Request processed in 5113us (12235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.365863:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786960662.366009:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967712896:0@lo:501: 00000100:00100000:1.0:1786960662.366066:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713024:0@lo:503: 00000100:00100000:1.0:1786960662.366128:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.366167:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.366386:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713024 00000100:00100000:2.0:1786960662.366393:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713024 00000100:00100000:2.0:1786960662.366429:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786960662.366437:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713024:12345-0@lo:503: 00000100:00100000:2.0:1786960662.366797:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713024:12345-0@lo:503: Request processed in 360us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.366804:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786960662.366929:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713024:0@lo:503: 00000040:00080000:1.0:1786960662.367421:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786960662.367502:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713152:0@lo:502: 00000100:00100000:1.0:1786960662.367542:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.367565:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.367629:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713152 00000100:00100000:2.0:1786960662.367634:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713152 00000100:00100000:2.0:1786960662.367655:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1786960662.367671:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713152:12345-0@lo:502: 00000100:00100000:2.0:1786960662.367834:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713152:12345-0@lo:502: Request processed in 172us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.367842:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786960662.368048:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713152:0@lo:502: 00000040:00080000:1.0:1786960662.368371:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1786960662.368420:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1786960662.368442:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713280:0@lo:502: 00000100:00100000:1.0:1786960662.368474:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.368491:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960662.368544:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713280 00000100:00100000:2.0:1786960662.368549:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713280 00000100:00100000:2.0:1786960662.368573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786960662.368579:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713280:12345-0@lo:502: 00000100:00100000:2.0:1786960662.368829:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713280:12345-0@lo:502: Request processed in 248us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960662.368836:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786960662.372777:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713280:0@lo:502: 00000040:00080000:1.0:1786960662.373122:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1786960662.373141:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1786960662.374377:0:7610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960662.374389:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960662.374392:0:7610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786960662.374399:0:7610:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766772e6000 00000020:00000080:1.0:1786960662.374401:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786960662.374422:0:7610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960662.374424:0:7610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960662.374426:0:7610:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1786960662.374429:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1786960662.374545:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1786960662.374567:0:7599:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960662.374631:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.374645:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960662.374694:0:7599:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786960662.374698:0:7599:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9766772e6000 10000000:01000000:0.0:1786960662.374701:0:7599:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9766772e6000 10000000:01000000:0.0:1786960662.374705:0:7599:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786960662.374711:0:7599:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9766772e6000 from 1 10000000:01000000:0.0:1786960662.374714:0:7599:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786960662.374750:0:7599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.374759:0:7599:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.374770:0:7599:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.374800:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713408:0@lo:101: 00000100:00100000:0.0:1786960662.374872:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.374924:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.375397:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713408 00000100:00100000:1.0:1786960662.375406:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713408 00000100:00100000:1.0:1786960662.375454:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1786960662.375470:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967713408:12345-0@lo:101: 00010000:00010000:1.0:1786960662.375484:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960662.375498:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f40a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.375522:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.375532:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.375541:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a000, rc 0) 00000100:00100000:1.0:1786960662.375589:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713408:12345-0@lo:101: Request processed in 121us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.375596:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786960662.375685:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713408:0@lo:101: 00010000:00010000:0.0:1786960662.375700:0:7599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960662.375709:0:7599:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960662.375816:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713536:0@lo:501: 00000100:00100000:0.0:1786960662.375841:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.375870:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.376164:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713536 00000100:00100000:1.0:1786960662.376169:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713536 00000100:00100000:1.0:1786960662.376223:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786960662.376287:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713536:12345-0@lo:501: 00000100:00100000:1.0:1786960662.376526:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713536:12345-0@lo:501: Request processed in 240us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.376533:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786960662.377220:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713536:0@lo:501: 00000100:00100000:0.0:1786960662.377387:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713664:0@lo:503: 00000100:00100000:0.0:1786960662.377440:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.377476:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6eff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.377577:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713664 00000100:00100000:1.0:1786960662.377583:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713664 00000100:00100000:1.0:1786960662.377618:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786960662.377625:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713664:12345-0@lo:503: 00000100:00100000:1.0:1786960662.377811:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713664:12345-0@lo:503: Request processed in 185us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.377826:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786960662.377901:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713664:0@lo:503: 00000040:00080000:2.0:1786960662.378329:0:7599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786960662.378392:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713792:0@lo:502: 00000100:00100000:2.0:1786960662.378429:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.378447:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960662.378517:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713792 00000100:00100000:0.0:1786960662.378522:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713792 00000100:00100000:0.0:1786960662.378545:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1786960662.378551:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713792:12345-0@lo:502: 00000100:00100000:0.0:1786960662.378711:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713792:12345-0@lo:502: Request processed in 159us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.378717:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786960662.378875:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713792:0@lo:502: 00000040:00080000:2.0:1786960662.379145:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1786960662.379493:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1786960662.379538:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1786960662.379592:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1786960662.379626:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1786960662.379677:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1786960662.379708:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1786960662.379736:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1786960662.379774:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1786960662.379804:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1786960662.379844:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1786960662.379884:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1786960662.379913:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1786960662.380007:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1786960662.380054:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1786960662.380083:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1786960662.380111:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1786960662.380148:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1786960662.380313:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1786960662.380357:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1786960662.380402:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1786960662.380467:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1786960662.380532:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1786960662.380587:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1786960662.380618:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1786960662.380645:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1786960662.380699:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1786960662.380729:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1786960662.380757:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1786960662.380808:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1786960662.380840:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1786960662.380867:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1786960662.380895:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1786960662.380957:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1786960662.380991:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1786960662.381046:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1786960662.381077:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1786960662.381117:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713920:0@lo:502: 00000100:00100000:2.0:1786960662.383758:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.383866:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960662.388633:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967713920 00000100:00100000:0.0:1786960662.388837:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967713920 00000100:00100000:0.0:1786960662.388912:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1786960662.388922:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713920:12345-0@lo:502: 00000100:00100000:0.0:1786960662.389437:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967713920:12345-0@lo:502: Request processed in 515us (8249us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960662.389445:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786960662.389570:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967713920:0@lo:502: 00000040:00080000:2.0:1786960662.389712:0:7599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1786960662.389730:0:7599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1786960662.390976:0:7611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1786960662.390994:0:7611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97664e46cd40) 00000020:00000080:2.0:1786960662.391031:0:7611:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1786960662.391259:0:7611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766772e6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786960662.391264:0:7611:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9766772e6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786960662.391268:0:7611:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766772e6000 3 00010000:00080000:2.0:1786960662.391314:0:7611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97667a685800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1786960662.396104:0:7611:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1786960662.396848:0:7611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1786960662.396898:0:7611:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786960662.396928:0:7611:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1808d16e4c97f41f 00000100:00080000:2.0:1786960662.396942:0:7611:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786960662.396948:0:7611:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97667a685800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960662.396985:0:7611:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97666b4b9880 x1873763967714048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786960662.397064:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967714048:0@lo:38: 00000100:00100000:3.0:1786960662.397148:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.397282:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714048 00000100:00100000:1.0:1786960662.397289:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714048 00000100:00100000:1.0:1786960662.397327:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786960662.397335:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1873763967714048:12345-0@lo:38: 00010000:00080000:1.0:1786960662.397457:0:5811:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:1.0:1786960662.397493:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1808d16e4c97f426 00000004:00100000:1.0:1786960662.397508:0:5811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1786960662.397551:0:5811:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1786960662.397621:0:7611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1786960662.399320:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967714176:0@lo:400: 00000100:00100000:2.0:1786960662.399383:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960662.399416:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960662.399422:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967714304:0@lo:400: 00000100:00100000:2.0:1786960662.399443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.400408:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1873763967714048:12345-0@lo:38: Request processed in 3066us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.400422:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786960662.400450:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714176 00000100:00100000:1.0:1786960662.400457:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714176 00000100:00100000:1.0:1786960662.400488:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714304 00000100:00100000:1.0:1786960662.400490:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714304 00000100:00100000:1.0:1786960662.400506:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786960662.400513:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967714176:12345-0@lo:400: 00000100:00100000:1.0:1786960662.401699:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967714176:12345-0@lo:400: Request processed in 1179us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.401711:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786960662.401744:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786960662.401753:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967714304:12345-0@lo:400: 00000100:00100000:1.0:1786960662.401795:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967714304:12345-0@lo:400: Request processed in 44us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960662.401800:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1786960662.401976:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4b9880 x1873763967714048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960662.401989:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786960662.402010:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1786960662.402019:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786960662.402025:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786960662.402028:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a685800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786960662.402037:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967714048:0@lo:38: 00000040:00080000:0.0:1786960662.402344:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1786960662.402463:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4b8e00 x1873763967714176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960662.402476:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967714176:0@lo:400: 00010000:00080000:2.0:1786960662.402577:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97666b4bb100 x1873763967714304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960662.402587:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967714304:0@lo:400: 00000020:01000000:1.0:1786960662.402623:0:7599:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1786960662.402653:0:7599:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786960662.402681:0:7599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.402698:0:7599:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786960662.402763:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786960662.402766:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786960662.402767:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960662.402769:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960662.402771:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960662.402772:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960662.402774:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960662.402775:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786960662.402777:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786960662.402779:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960662.402780:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786960662.402784:0:7599:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1786960662.402793:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786960662.402794:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786960662.402796:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960662.402797:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960662.402798:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960662.402799:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960662.402800:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960662.402802:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786960662.402803:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786960662.402804:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960662.402806:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786960662.402833:0:7599:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786960662.402849:0:7599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967714432:0@lo:253: 00000100:00100000:1.0:1786960662.402912:0:7599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.402954:0:7599:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960662.402971:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714432 00000100:00100000:1.0:1786960662.402989:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714432 00000100:00100000:1.0:1786960662.403038:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786960662.403045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:7599:x1873763967714432:12345-0@lo:253: 20000000:01000000:1.0:1786960662.403076:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786960662.403099:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1786960662.407157:0:7613:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1873763967714560:0@lo:901: 00000100:00100000:0.0:1786960662.407842:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960662.407913:0:7613:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.407959:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714560 00000100:00100000:3.0:1786960662.407967:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714560 00000100:00100000:3.0:1786960662.408062:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960662.408072:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1873763967714560:12345-0@lo:901: 00000100:00100000:3.0:1786960662.408514:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7613:x1873763967714560:12345-0@lo:901: Request processed in 443us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.408539:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1786960662.408885:0:7613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff976673ad2a00 x1873763967714560/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1786960678 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960662.408909:0:7613:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7613:1873763967714560:0@lo:901: 00000100:00080000:0.0:1786960662.410876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1786960662.436384:0:5805:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786960662.436407:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1786960662.437571:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1786960662.437579:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1786960662.437606:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.437625:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.437635:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.437689:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960662.437704:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960662.437723:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967714688:0@lo:104: 00000100:00100000:1.0:1786960662.437798:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960662.437850:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efc240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960662.438741:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714688 00000100:00100000:3.0:1786960662.438751:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714688 00000100:00100000:3.0:1786960662.438802:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960662.438812:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967714688:12345-0@lo:104: 00010000:00010000:3.0:1786960662.438828:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.438914:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786960662.438920:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+3:5826:x1873763967714688:12345-0@lo:104: Request processed in 110us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.438928:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1786960662.438951:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960662.438957:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.438966:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960662.438971:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.438981:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960662.438990:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960662.439010:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1786960662.439043:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439051:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960662.439071:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439077:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169b600/0x1808d16e4c97f377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f37e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439106:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960662.439108:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960662.439110:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960662.439132:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967714816:0@lo:103: 00000100:00100000:3.0:1786960662.439167:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960662.439240:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714816 00000100:00100000:3.0:1786960662.439244:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714816 00010000:00010000:3.0:1786960662.439261:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.439283:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960662.439288:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3285:x1873763967714816:12345-0@lo:103: 00010000:00010000:3.0:1786960662.439298:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960662.439303:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439314:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 15 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439331:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439339:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1786960662.439353:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002879146s 00010000:00010000:3.0:1786960662.439358:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439375:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439383:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439390:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439395:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960662.439399:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439406:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439416:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439426:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960662.439450:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3285:x1873763967714816:12345-0@lo:103: Request processed in 162us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.439457:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960662.439524:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967714816:0@lo:103: 00010000:00010000:3.0:1786960662.439550:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168400/0x1808d16e4c97f37e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f377 expref: 14 pid: 5805 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.439572:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1873763967714688:0@lo:104: 00010000:00010000:3.0:1786960662.439584:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439598:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439604:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960662.439611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a200/0x1808d16e4c97f42d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960662.484287:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:7599:x1873763967714432:12345-0@lo:253: Request processed in 81229us (81366us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960662.484307:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786960662.484473:0:7599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c3f21e71-ba64-41c6-8589-43a20e36767f:7599:1873763967714432:0@lo:253: 10000000:01000000:1.0:1786960662.484513:0:7599:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1786960662.484517:0:7599:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786960662.484519:0:7599:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786960662.484521:0:7599:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960662.484522:0:7599:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960662.484523:0:7599:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960662.484525:0:7599:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960662.484526:0:7599:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960662.484528:0:7599:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786960662.484530:0:7599:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786960662.484593:0:7599:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960662.484594:0:7599:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786960662.484611:0:7599:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786960662.490704:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960662.490906:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786960662.491140:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960662.491373:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786960662.491612:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1786960662.491846:0:7599:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1786960662.494492:0:7599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1786960662.715416:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1786960662.736659:0:7599:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1786960662.736668:0:7599:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1786960662.736711:0:7599:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786960662.736775:0:7599:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786960662.736792:0:7599:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1786960662.743651:0:7599:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1786960663.737963:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960664.759661:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960665.782010:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960666.804813:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960667.444760:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967715328:0@lo:400: 00000100:00100000:3.0:1786960667.444865:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.444925:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786960667.444932:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967714944:0@lo:13: 00000100:00100000:3.0:1786960667.444959:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.444997:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967715456:0@lo:400: 00000100:00100000:3.0:1786960667.445018:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.445043:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967715200:0@lo:400: 00000100:00100000:3.0:1786960667.445079:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.445100:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786960667.445105:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967715072:0@lo:400: 00000100:00100000:3.0:1786960667.445134:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.445164:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967715584:0@lo:400: 00000100:00100000:3.0:1786960667.445334:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960667.445364:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715328 00000100:00100000:3.0:1786960667.445373:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715328 00000100:00100000:3.0:1786960667.445428:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715200 00000100:00100000:3.0:1786960667.445430:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715200 00000100:00100000:3.0:1786960667.445440:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715584 00000100:00100000:3.0:1786960667.445442:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715584 00000100:00100000:3.0:1786960667.445456:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960667.445465:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967715328:12345-0@lo:400: 00000100:00100000:3.0:1786960667.445523:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967715328:12345-0@lo:400: Request processed in 58us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445531:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960667.445548:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786960667.445556:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967715200:12345-0@lo:400: 00000100:00100000:3.0:1786960667.445588:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967715200:12345-0@lo:400: Request processed in 33us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445593:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786960667.445605:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786960667.445612:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967715584:12345-0@lo:400: 00000100:00100000:3.0:1786960667.445637:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967715584:12345-0@lo:400: Request processed in 27us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445643:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786960667.445666:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967714944 00000100:00100000:3.0:1786960667.445670:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967714944 00000100:00100000:3.0:1786960667.445697:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960667.445703:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967714944:12345-0@lo:13: 00002000:00000024:3.0:1786960667.445732:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960667.445773:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967714944:12345-0@lo:13: Request processed in 70us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445779:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960667.445799:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715456 00000100:00100000:3.0:1786960667.445802:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715456 00000100:00100000:3.0:1786960667.445825:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960667.445831:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967715456:12345-0@lo:400: 00000100:00100000:3.0:1786960667.445860:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967715456:12345-0@lo:400: Request processed in 29us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445866:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960667.445886:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715072 00000100:00100000:3.0:1786960667.445889:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715072 00000100:00100000:3.0:1786960667.445912:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786960667.445918:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3288:x1873763967715072:12345-0@lo:400: 00000100:00100000:3.0:1786960667.445948:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3288:x1873763967715072:12345-0@lo:400: Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960667.445954:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1786960667.445994:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960667.445999:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960667.446032:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967715072:0@lo:400: 00010000:00080000:3.0:1786960667.446048:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69ce00 x1873763967715584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960667.446060:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967715584:0@lo:400: 00010000:00080000:3.0:1786960667.446070:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69ca80 x1873763967715200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960667.446077:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967715200:0@lo:400: 00010000:00080000:3.0:1786960667.446125:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4bb100 x1873763967714944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960667.446139:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967714944:0@lo:13: 00010000:00080000:3.0:1786960667.446147:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69d180 x1873763967715456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960667.446155:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967715456:0@lo:400: 00010000:00080000:3.0:1786960667.446165:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69c380 x1873763967715328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960667.446173:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967715328:0@lo:400: 00010000:00010000:3.0:1786960667.828395:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960668.853881:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786960669.637821:0:7954:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786960669.879516:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960670.902048:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960671.924353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786960672.564727:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786960672.564735:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97667ad21800 from 30 10000000:01000000:3.0:1786960672.564742:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786960672.564790:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.564802:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.564813:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960672.564835:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967715712:0@lo:101: 00000100:00100000:3.0:1786960672.564917:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.565047:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960672.565062:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967715840:0@lo:13: 00000100:00100000:2.0:1786960672.565096:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.565203:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715840 00000100:00100000:2.0:1786960672.565211:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715840 00000100:00100000:2.0:1786960672.565262:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960672.565272:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967715840:12345-0@lo:13: 00002000:00000024:2.0:1786960672.565303:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960672.565346:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967715840:12345-0@lo:13: Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.565353:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1786960672.565405:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b8e00 x1873763967715840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960672.565422:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967715840:0@lo:13: 00000100:00080000:2.0:1786960672.565450:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960672.565681:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967716096:0@lo:400: 00000100:00100000:0.0:1786960672.565748:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.565787:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960672.565793:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967715968:0@lo:400: 00000100:00100000:0.0:1786960672.565818:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.565866:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967716352:0@lo:400: 00000100:00100000:2.0:1786960672.565895:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.565914:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960672.565919:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967716224:0@lo:400: 00000100:00100000:2.0:1786960672.565953:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.565979:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716096 00000100:00100000:2.0:1786960672.565984:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716096 00000100:00100000:2.0:1786960672.566004:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716352 00000100:00100000:2.0:1786960672.566006:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716352 00000100:00100000:2.0:1786960672.566022:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716224 00000100:00100000:2.0:1786960672.566024:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716224 00000100:00100000:2.0:1786960672.566035:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786960672.566042:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967716096:12345-0@lo:400: 00000100:00100000:2.0:1786960672.566073:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967716096:12345-0@lo:400: Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.566079:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786960672.566101:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786960672.566106:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967716352:12345-0@lo:400: 00000100:00100000:2.0:1786960672.566137:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967716352:12345-0@lo:400: Request processed in 31us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.566142:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786960672.566153:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786960672.566159:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967716224:12345-0@lo:400: 00000100:00100000:2.0:1786960672.566182:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967716224:12345-0@lo:400: Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.566206:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1786960672.566220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786960672.566238:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad3100 x1873763967716224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960672.566247:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967716224:0@lo:400: 00010000:00080000:2.0:1786960672.566257:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad0a80 x1873763967716352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960672.566265:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967716352:0@lo:400: 00000100:00100000:3.0:1786960672.570317:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.574523:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715712 00000100:00100000:3.0:1786960672.574537:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715712 00000100:00100000:3.0:1786960672.574624:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967715968 00000100:00100000:3.0:1786960672.574629:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967715968 00000100:00100000:3.0:1786960672.574651:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786960672.574660:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967715712:12345-0@lo:101: 00010000:00010000:3.0:1786960672.574676:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960672.574693:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f434 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.574721:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.574733:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.574742:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168800, rc 0) 00000100:00100000:2.0:1786960672.574743:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786960672.574756:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3286:x1873763967715968:12345-0@lo:400: 00000100:00100000:3.0:1786960672.575666:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967715712:12345-0@lo:101: Request processed in 1004us (10746us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.575676:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786960672.575733:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967715712:0@lo:101: 00010000:00010000:3.0:1786960672.575751:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.576073:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960672.576145:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716480:0@lo:501: 00000100:00100000:3.0:1786960672.576616:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960672.576683:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.576759:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716480 00000100:00100000:2.0:1786960672.576819:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:3286:x1873763967715968:12345-0@lo:400: Request processed in 2065us (10997us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.576828:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1786960672.576872:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716480 00000100:00100000:1.0:1786960672.576957:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1786960672.576966:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967716480:12345-0@lo:501: 00000100:00100000:1.0:1786960672.578020:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967716480:12345-0@lo:501: Request processed in 1053us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.578039:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1786960672.578132:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad0000 x1873763967716096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960672.578146:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967716096:0@lo:400: 00000100:00100000:0.0:1786960672.578180:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967715968:0@lo:400: 00000100:00100000:2.0:1786960672.579043:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716480:0@lo:501: 00000100:00100000:2.0:1786960672.579089:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716608:0@lo:503: 00000100:00100000:2.0:1786960672.579149:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960672.588683:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716608 00000100:00100000:3.0:1786960672.588715:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716608 00000100:00100000:2.0:1786960672.588732:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6de180 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.588769:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1786960672.588864:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967716608:12345-0@lo:503: 00000100:00100000:3.0:1786960672.589741:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967716608:12345-0@lo:503: Request processed in 959us (10587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.589750:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786960672.589865:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716608:0@lo:503: 00000100:00100000:1.0:1786960672.592017:0:8059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8059:1873763967716736:0@lo:502: 00000100:00100000:1.0:1786960672.592092:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960672.592135:0:8059:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766654cf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960672.592635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716736 00000100:00100000:0.0:1786960672.592644:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716736 00000100:00100000:0.0:1786960672.592693:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786960672.592702:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8059:x1873763967716736:12345-0@lo:502: 00000100:00100000:0.0:1786960672.593052:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8059:x1873763967716736:12345-0@lo:502: Request processed in 350us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.593059:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1786960672.593276:0:8059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8059:1873763967716736:0@lo:502: 00000100:00100000:1.0:1786960672.593332:0:8059:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8059:1873763967716864:0@lo:502: 00000100:00100000:1.0:1786960672.593369:0:8059:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960672.593407:0:8059:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766654cf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.593473:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716864 00000100:00100000:3.0:1786960672.593478:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716864 00000100:00100000:3.0:1786960672.593713:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1786960672.593721:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8059:x1873763967716864:12345-0@lo:502: 00000100:00100000:3.0:1786960672.594025:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8059:x1873763967716864:12345-0@lo:502: Request processed in 304us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.594038:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786960672.594753:0:8059:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8059:1873763967716864:0@lo:502: 00000040:00080000:1.0:1786960672.594799:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1786960672.595450:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1786960672.595470:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786960672.595663:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.595677:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960672.595688:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1786960672.595690:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1786960672.595693:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1786960672.595727:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.595735:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.595745:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960672.595778:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716992:0@lo:101: 00000100:00100000:2.0:1786960672.595832:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.595874:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6dec00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.597770:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967716992 00000100:00100000:1.0:1786960672.597784:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967716992 00000100:00100000:1.0:1786960672.597846:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786960672.597855:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967716992:12345-0@lo:101: 00010000:00010000:1.0:1786960672.597872:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960672.597890:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f442 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.597917:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.597940:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.597950:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a400, rc 0) 00000100:00100000:1.0:1786960672.598018:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967716992:12345-0@lo:101: Request processed in 163us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.598037:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786960672.598898:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967716992:0@lo:101: 00010000:00010000:0.0:1786960672.598943:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960672.598955:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960672.599025:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717120:0@lo:501: 00000100:00100000:0.0:1786960672.599065:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.599106:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960672.599421:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717120 00000100:00100000:2.0:1786960672.599428:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717120 00000100:00100000:2.0:1786960672.599475:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786960672.599613:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967717120:12345-0@lo:501: 00000100:00100000:2.0:1786960672.600018:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967717120:12345-0@lo:501: Request processed in 533us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.600032:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786960672.600890:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717120:0@lo:501: 00000100:00100000:0.0:1786960672.601006:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717248:0@lo:503: 00000100:00100000:0.0:1786960672.601061:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.601102:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.601160:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717248 00000100:00100000:3.0:1786960672.601166:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717248 00000100:00100000:3.0:1786960672.601233:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1786960672.601241:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967717248:12345-0@lo:503: 00000100:00100000:3.0:1786960672.602617:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967717248:12345-0@lo:503: Request processed in 1372us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.602627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1786960672.603908:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717248:0@lo:503: 00000100:00100000:0.0:1786960672.604332:0:8060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8060:1873763967717376:0@lo:502: 00000100:00100000:0.0:1786960672.604397:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.604438:0:8060:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.604501:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717376 00000100:00100000:1.0:1786960672.604508:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717376 00000100:00100000:1.0:1786960672.604553:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786960672.604561:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8060:x1873763967717376:12345-0@lo:502: 00000100:00100000:1.0:1786960672.604810:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8060:x1873763967717376:12345-0@lo:502: Request processed in 249us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.604817:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1786960672.605065:0:8060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8060:1873763967717376:0@lo:502: 00000020:01000000:0.0:1786960672.605092:0:8060:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960672.605101:0:8060:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960672.605104:0:8060:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786960672.605108:0:8060:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786960672.605111:0:8060:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786960672.605128:0:8060:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8060:1873763967717504:0@lo:502: 00000100:00100000:0.0:1786960672.605162:0:8060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.605211:0:8060:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.605505:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717504 00000100:00100000:1.0:1786960672.605510:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717504 00000100:00100000:1.0:1786960672.605536:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1786960672.605543:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8060:x1873763967717504:12345-0@lo:502: 00000100:00100000:1.0:1786960672.605688:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8060:x1873763967717504:12345-0@lo:502: Request processed in 146us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.605695:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1786960672.605914:0:8060:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8060:1873763967717504:0@lo:502: 00000020:01000000:2.0:1786960672.605945:0:8060:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960672.605951:0:8060:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960672.605952:0:8060:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786960672.605956:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1786960672.606110:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1786960672.606126:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786960672.606135:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.606146:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960672.606154:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786960672.606157:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff976652341800 from 30 10000000:01000000:1.0:1786960672.606160:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960672.606213:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.606233:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.606243:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960672.606259:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717632:0@lo:101: 00000100:00100000:1.0:1786960672.606289:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960672.606311:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766654cfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960672.606365:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717632 00000100:00100000:2.0:1786960672.606370:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717632 00000100:00100000:2.0:1786960672.606404:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1786960672.606411:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967717632:12345-0@lo:101: 00010000:00010000:2.0:1786960672.606419:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960672.606432:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f450 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.606452:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.606461:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.606469:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045c00, rc 0) 00000100:00100000:2.0:1786960672.606522:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967717632:12345-0@lo:101: Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.606527:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1786960672.606626:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717632:0@lo:101: 00010000:00010000:3.0:1786960672.606639:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.606648:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960672.606691:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717760:0@lo:501: 00000100:00100000:3.0:1786960672.606725:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960672.606746:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960672.607006:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717760 00000100:00100000:0.0:1786960672.607011:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717760 00000100:00100000:0.0:1786960672.607029:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1786960672.607035:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967717760:12345-0@lo:501: 00000100:00100000:0.0:1786960672.607477:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967717760:12345-0@lo:501: Request processed in 440us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.607498:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1786960672.616713:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717760:0@lo:501: 00000100:00100000:2.0:1786960672.626319:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717888:0@lo:503: 00000100:00100000:2.0:1786960672.626407:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.626446:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6de480 going to sleep for 11 seconds 00000100:00100000:0.0:1786960672.626575:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967717888 00000100:00100000:0.0:1786960672.626583:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967717888 00000100:00100000:0.0:1786960672.626636:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786960672.626645:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967717888:12345-0@lo:503: 00000100:00100000:0.0:1786960672.626838:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967717888:12345-0@lo:503: Request processed in 195us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.626845:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1786960672.626986:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967717888:0@lo:503: 00000100:00100000:0.0:1786960672.627445:0:8061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8061:1873763967718016:0@lo:502: 00000100:00100000:0.0:1786960672.627485:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.627515:0:8061:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.627560:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718016 00000100:00100000:1.0:1786960672.627565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718016 00000100:00100000:1.0:1786960672.627598:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1786960672.627605:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8061:x1873763967718016:12345-0@lo:502: 00000100:00100000:1.0:1786960672.627786:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8061:x1873763967718016:12345-0@lo:502: Request processed in 180us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.627792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1786960672.627861:0:8061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8061:1873763967718016:0@lo:502: 00000100:00100000:2.0:1786960672.627910:0:8061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8061:1873763967718144:0@lo:502: 00000100:00100000:2.0:1786960672.627953:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.627973:0:8061:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.628014:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718144 00000100:00100000:1.0:1786960672.628019:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718144 00000100:00100000:1.0:1786960672.628048:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786960672.628054:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8061:x1873763967718144:12345-0@lo:502: 00000100:00100000:1.0:1786960672.628182:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8061:x1873763967718144:12345-0@lo:502: Request processed in 127us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.628216:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786960672.628333:0:8061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8061:1873763967718144:0@lo:502: 00000040:00080000:2.0:1786960672.628352:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1786960672.628486:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1786960672.628504:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786960672.628514:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.628524:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960672.628534:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786960672.628536:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff976652341800 from 5 10000000:01000000:3.0:1786960672.628539:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786960672.628564:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.628571:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.628580:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960672.628591:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718272:0@lo:101: 00000100:00100000:3.0:1786960672.628619:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960672.628649:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.628693:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718272 00000100:00100000:1.0:1786960672.628698:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718272 00000100:00100000:1.0:1786960672.628726:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1786960672.628733:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967718272:12345-0@lo:101: 00010000:00010000:1.0:1786960672.628748:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960672.628761:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169b800/0x1808d16e4c97f465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f45e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.628779:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169b800/0x1808d16e4c97f465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f45e expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.628789:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169b800/0x1808d16e4c97f465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f45e expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.628798:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b800, rc 0) 00000100:00100000:1.0:1786960672.628834:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967718272:12345-0@lo:101: Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.628841:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786960672.628901:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718272:0@lo:101: 00010000:00010000:2.0:1786960672.628914:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.628922:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960672.628970:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718400:0@lo:256: 00000100:00100000:2.0:1786960672.628999:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.629018:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.629064:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718400 00000100:00100000:3.0:1786960672.629068:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718400 00000100:00100000:3.0:1786960672.629094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786960672.629100:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967718400:12345-0@lo:256: 20000000:01000000:3.0:1786960672.629113:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786960672.629128:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786960672.629131:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1786960672.629233:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967718400:12345-0@lo:256: Request processed in 133us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.629241:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1786960672.629316:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718400:0@lo:256: 10000000:01000000:2.0:1786960672.629357:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786960672.629363:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.629370:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960672.629376:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1786960672.629377:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1786960672.629379:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1786960672.629395:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.629406:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.629414:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960672.629425:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718528:0@lo:101: 00000100:00100000:2.0:1786960672.629448:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.629470:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.629523:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718528 00000100:00100000:1.0:1786960672.629527:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718528 00000100:00100000:1.0:1786960672.629545:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786960672.629550:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967718528:12345-0@lo:101: 00010000:00010000:1.0:1786960672.629557:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960672.629566:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f46c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.629580:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.629589:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.629595:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169be00, rc 0) 00000100:00100000:1.0:1786960672.629635:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967718528:12345-0@lo:101: Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960672.629640:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1786960672.629732:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718528:0@lo:101: 00010000:00010000:2.0:1786960672.629742:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960672.629749:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960672.629786:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718656:0@lo:501: 00000100:00100000:2.0:1786960672.629808:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.629836:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960672.629891:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718656 00000100:00100000:0.0:1786960672.629895:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718656 00000100:00100000:0.0:1786960672.629938:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786960672.629944:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967718656:12345-0@lo:501: 00000100:00100000:0.0:1786960672.630183:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967718656:12345-0@lo:501: Request processed in 238us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.630215:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1786960672.630338:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718656:0@lo:501: 00000100:00100000:2.0:1786960672.630365:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718784:0@lo:503: 00000100:00100000:2.0:1786960672.630401:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.630431:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.630473:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718784 00000100:00100000:3.0:1786960672.630478:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718784 00000100:00100000:3.0:1786960672.630517:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786960672.630523:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967718784:12345-0@lo:503: 00000100:00100000:3.0:1786960672.630812:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967718784:12345-0@lo:503: Request processed in 288us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.630819:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786960672.631168:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967718784:0@lo:503: 00000100:00100000:2.0:1786960672.637464:0:8062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8062:1873763967718912:0@lo:502: 00000100:00100000:2.0:1786960672.637556:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.637604:0:8062:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6de0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.637732:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967718912 00000100:00100000:3.0:1786960672.637740:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967718912 00000100:00100000:3.0:1786960672.637837:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786960672.637847:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8062:x1873763967718912:12345-0@lo:502: 00000100:00100000:3.0:1786960672.638168:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8062:x1873763967718912:12345-0@lo:502: Request processed in 322us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.638175:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1786960672.638300:0:8062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8062:1873763967718912:0@lo:502: 00000020:01000000:2.0:1786960672.638329:0:8062:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786960672.638336:0:8062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1786960672.638342:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960672.638345:0:8062:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1786960672.638349:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786960672.638352:0:8062:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1786960672.638372:0:8062:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1786960672.638375:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786960672.638389:0:8062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97664e468000) 00000020:00000080:2.0:1786960672.638411:0:8062:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1786960672.638416:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786960672.638495:0:8062:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1786960672.638500:0:8062:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1786960672.638508:0:8062:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c97f481 00010000:00080000:2.0:1786960672.638535:0:8062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97667ab15000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1786960672.638770:0:8062:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1786960672.639079:0:8062:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1786960672.639092:0:8062:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786960672.639641:0:8062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960672.639867:0:8062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960672.639919:0:8062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1786960672.639990:0:8062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1786960672.643270:0:8063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960672.643278:0:8063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1786960672.645509:0:8062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786960672.645524:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786960672.645560:0:8062:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1786960672.645583:0:8062:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c97f488 00000100:00080000:2.0:1786960672.645594:0:8062:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786960672.645606:0:8062:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97667ab15000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960672.645640:0:8062:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97666b4bb800 x1873763967719040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786960672.645667:0:8062:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1786960672.645719:0:8062:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960672.645723:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960672.645725:0:8062:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1786960672.645728:0:8062:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960672.645731:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960672.645733:0:8062:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960672.645735:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960672.645737:0:8062:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1786960672.646014:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967719040:0@lo:8: 00000100:00100000:3.0:1786960672.646081:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.646183:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719040 00000100:00100000:0.0:1786960672.646204:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719040 00000100:00100000:0.0:1786960672.646243:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786960672.646250:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967719040:12345-0@lo:8: 00010000:00080000:0.0:1786960672.646274:0:6658:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:0.0:1786960672.646299:0:6658:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c97f48f 00002000:00100000:0.0:1786960672.646312:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97667ac8c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1786960672.646316:0:6658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1786960672.646320:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1786960672.646436:0:6658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1786960672.646587:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786960672.646610:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667ac8b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960672.646661:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1873763967719040:12345-0@lo:8: Request processed in 410us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.646668:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960672.646902:0:8062:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8062:1873763967719168:0@lo:502: 00000100:00100000:2.0:1786960672.646977:0:8062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.646999:0:8062:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6dee40 going to sleep for 11 seconds 00010000:00080000:3.0:1786960672.647074:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4bb800 x1873763967719040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786960682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960672.647084:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786960672.647098:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1786960672.647105:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786960672.647110:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786960672.647113:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667ab15000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786960672.647132:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786960672.647138:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967719040:0@lo:8: 00000004:00080000:3.0:1786960672.647160:0:8063:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1786960672.647288:0:8063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 154674100952ns, next at 0ns, rc = 0 00000100:00100000:0.0:1786960672.648678:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719168 00000100:00100000:0.0:1786960672.648689:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719168 00000100:00100000:0.0:1786960672.648747:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786960672.648757:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8062:x1873763967719168:12345-0@lo:502: 00000100:00100000:0.0:1786960672.649018:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8062:x1873763967719168:12345-0@lo:502: Request processed in 262us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.649034:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786960672.651643:0:8062:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8062:1873763967719168:0@lo:502: 00000020:01000000:0.0:1786960672.651687:0:8062:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960672.651694:0:8062:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960672.651696:0:8062:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786960672.651700:0:8062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1786960672.651769:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1786960672.651785:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786960672.651795:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960672.651807:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960672.651817:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786960672.651820:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97664e5c8000 from 1 10000000:01000000:0.0:1786960672.651823:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786960672.651853:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960672.651861:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960672.651869:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960672.651886:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967719296:0@lo:101: 00000100:00100000:0.0:1786960672.660069:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.660128:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.662529:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719296 00000100:00100000:3.0:1786960672.662542:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719296 00000100:00100000:3.0:1786960672.662589:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786960672.662599:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967719296:12345-0@lo:101: 00010000:00010000:3.0:1786960672.662616:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960672.662634:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f496 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.662662:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.662673:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960672.662683:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:3.0:1786960672.662753:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967719296:12345-0@lo:101: Request processed in 155us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.662760:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786960672.670981:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967719296:0@lo:101: 00010000:00010000:0.0:1786960672.671011:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960672.671024:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960672.671107:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967719424:0@lo:501: 00000100:00100000:0.0:1786960672.671181:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.671241:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.671507:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719424 00000100:00100000:3.0:1786960672.671514:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719424 00000100:00100000:3.0:1786960672.671565:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786960672.671587:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967719424:12345-0@lo:501: 00000100:00100000:3.0:1786960672.671847:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967719424:12345-0@lo:501: Request processed in 261us (665us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960672.671856:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786960672.671996:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967719424:0@lo:501: 10000000:01000000:1.0:1786960672.672023:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786960672.672030:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960672.672039:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786960672.735511:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1786960672.777717:0:8064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1786960672.777750:0:8064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719680:0@lo:7: 00000100:00100000:0.0:1786960672.777834:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.777897:0:8064:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590480 going to sleep for 11 seconds 00000100:00100000:1.0:1786960672.777999:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960672.778014:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967719552:0@lo:13: 00000100:00100000:1.0:1786960672.778049:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.778124:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719552 00000100:00100000:0.0:1786960672.778131:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719552 00000100:00080000:1.0:1786960672.778282:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960672.778437:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719680 00000100:00100000:3.0:1786960672.778442:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719680 00000100:00100000:3.0:1786960672.778486:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960672.778495:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8064:x1873763967719680:12345-0@lo:7: 00000100:00100000:2.0:1786960672.778901:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960672.778910:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1873763967719552:12345-0@lo:13: 00002000:00000024:2.0:1786960672.778943:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1786960672.779002:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1873763967719552:12345-0@lo:13: Request processed in 94us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960672.779009:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1786960672.780328:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad1180 x1873763967719552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960672.780349:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967719552:0@lo:13: 00002000:00080000:3.0:1786960672.794871:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1786960672.794879:0:6660:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1786960672.794972:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8064:x1873763967719680:12345-0@lo:7: Request processed in 16475us (17135us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960672.794982:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1786960672.795110:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad2a00 x1873763967719680/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786960688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960672.795124:0:8064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719680:0@lo:7: 00000004:00080000:0.0:1786960672.795136:0:8064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1786960672.795179:0:8064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719808:0@lo:5: 00000100:00100000:0.0:1786960672.795234:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960672.795282:0:8064:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590480 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.795480:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719808 00000100:00100000:3.0:1786960672.795486:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719808 00000100:00100000:3.0:1786960672.795522:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960672.795530:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8064:x1873763967719808:12345-0@lo:5: 00002000:00080000:3.0:1786960672.795551:0:6659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1786960672.795554:0:6659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1786960672.795770:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8064:x1873763967719808:12345-0@lo:5: Request processed in 233us (528us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1786960672.795777:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1786960672.798489:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad2a00 x1873763967719808/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786960688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960672.798510:0:8064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719808:0@lo:5: 00000004:00080000:2.0:1786960672.798524:0:8064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1786960672.798565:0:8064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719936:0@lo:700: 00000100:00100000:2.0:1786960672.798617:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960672.798677:0:8064:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647a1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1786960672.798905:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967719936 00000100:00100000:3.0:1786960672.798912:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967719936 00000100:00100000:3.0:1786960672.798979:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960672.798988:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8064:x1873763967719936:12345-0@lo:700: 00000100:00100000:3.0:1786960672.799026:0:6666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6666:1873763967720064:0@lo:700: 00000100:00100000:3.0:1786960672.799068:0:6666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960672.799095:0:6666:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648d23cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960672.799152:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720064 00000100:00100000:0.0:1786960672.799166:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720064 00000100:00100000:0.0:1786960672.799263:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786960672.799271:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6666:x1873763967720064:12345-0@lo:700: 40000000:02000000:0.0:1786960672.884512:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1786960672.898941:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6666:x1873763967720064:12345-0@lo:700: Request processed in 99653us (99854us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960672.898956:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786960672.900035:0:6666:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743a8000 x1873763967720064/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786960688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960672.900052:0:6666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6666:1873763967720064:0@lo:700: 40000000:02000000:2.0:1786960672.900064:0:6666:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1786960672.975174:0:260:0:(ldlm_pool.c:1332:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:3.0:1786960672.975210:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786960673.027460:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1786960673.027496:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1786960673.027601:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8064:x1873763967719936:12345-0@lo:700: Request processed in 228610us (228979us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960673.027613:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786960673.027677:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b9880 x1873763967719936/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786960688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960673.027688:0:8064:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1786960673.027704:0:8064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967719936:0@lo:700: 00000004:02000040:2.0:1786960673.060286:0:8064:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1786960673.065711:0:8064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967720192:0@lo:5: 00000100:00100000:2.0:1786960673.065781:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960673.065841:0:8064:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960673.065849:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720192 00000100:00100000:1.0:1786960673.065858:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720192 00000100:00100000:1.0:1786960673.065904:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786960673.065916:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8064:x1873763967720192:12345-0@lo:5: 00002000:00080000:1.0:1786960673.075254:0:6660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1786960673.075274:0:6660:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1786960673.085748:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8064:x1873763967720192:12345-0@lo:5: Request processed in 19828us (19961us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1786960673.085762:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1786960673.085854:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b9880 x1873763967720192/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786960689 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960673.085872:0:8064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1873763967720192:0@lo:5: 00000004:00080000:3.0:1786960673.085887:0:8064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1786960674.036706:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960675.071999:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786960675.441426:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1786960676.066215:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.066372:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958259840 00000100:00100000:3.0:1786960676.066387:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958259840 00000100:00100000:3.0:1786960676.066441:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:3.0:1786960676.066451:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2340:x1873763958259840:12345-192.168.203.23@tcp:250: 00010000:00080000:3.0:1786960676.066483:0:5804:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from d2a0b7eb-402f-48c4-b539-94a5ccdd0ced@192.168.203.23@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1786960676.066514:0:5804:0:(genops.c:1406:class_connect()) connect: client d2a0b7eb-402f-48c4-b539-94a5ccdd0ced, cookie 0x1808d16e4c97f4a4 00000100:00080000:3.0:1786960676.066703:0:5804:0:(import.c:65:import_set_state_nolock()) ffff976664d2f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960676.066784:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+5:2340:x1873763958259840:12345-192.168.203.23@tcp:250: Request processed in 333us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960676.066792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00010000:00010000:2.0:1786960676.084851:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960676.089724:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960676.089870:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958259968 00000100:00100000:0.0:1786960676.089880:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958259968 00000100:00100000:0.0:1786960676.089966:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1786960676.089976:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+5:5569:x1873763958259968:12345-192.168.203.23@tcp:101: 00010000:00010000:0.0:1786960676.089993:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960676.090010:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bd92 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960676.090047:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960676.090059:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960676.090068:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960676.090120:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+6:5569:x1873763958259968:12345-192.168.203.23@tcp:101: Request processed in 146us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960676.090127:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1786960676.098347:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.099704:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260096 00000100:00100000:3.0:1786960676.099722:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260096 00000100:00100000:3.0:1786960676.099803:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1786960676.099815:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+6:5569:x1873763958260096:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1786960676.100304:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+6:5569:x1873763958260096:12345-192.168.203.23@tcp:501: Request processed in 489us (1963us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960676.100315:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:0.0:1786960676.112277:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.112353:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260224 00000100:00100000:3.0:1786960676.112377:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260224 00000100:00100000:3.0:1786960676.112442:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:3.0:1786960676.112453:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+6:5569:x1873763958260224:12345-192.168.203.23@tcp:101: 00010000:00010000:3.0:1786960676.112472:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960676.112490:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bd99 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.112518:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.112529:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.112539:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169400, rc 0) 00000100:00100000:3.0:1786960676.112609:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+7:5569:x1873763958260224:12345-192.168.203.23@tcp:101: Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960676.112616:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:0.0:1786960676.120123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.124800:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260352 00000100:00100000:3.0:1786960676.124815:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260352 00000100:00100000:3.0:1786960676.124887:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1786960676.124896:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+7:5569:x1873763958260352:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1786960676.125217:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5569:x1873763958260352:12345-192.168.203.23@tcp:501: Request processed in 321us (5106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960676.125225:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:1.0:1786960676.142453:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960676.142560:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260480 00000100:00100000:0.0:1786960676.142570:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260480 00000100:00100000:0.0:1786960676.142643:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:0.0:1786960676.142653:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5569:x1873763958260480:12345-192.168.203.23@tcp:503: 00000100:00100000:0.0:1786960676.142931:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5569:x1873763958260480:12345-192.168.203.23@tcp:503: Request processed in 279us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960676.142939:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:0.0:1786960676.147097:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.147570:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260608 00000100:00100000:3.0:1786960676.147579:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260608 00000100:00100000:3.0:1786960676.147618:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:3.0:1786960676.147626:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5587:x1873763958260608:12345-192.168.203.23@tcp:502: 00000100:00100000:3.0:1786960676.147956:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5587:x1873763958260608:12345-192.168.203.23@tcp:502: Request processed in 330us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960676.147964:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:0.0:1786960676.218120:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960676.218160:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260736 00000100:00100000:0.0:1786960676.218168:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260736 00000100:00100000:0.0:1786960676.218251:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:0.0:1786960676.218262:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5587:x1873763958260736:12345-192.168.203.23@tcp:502: 00000100:00100000:0.0:1786960676.219986:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5587:x1873763958260736:12345-192.168.203.23@tcp:502: Request processed in 1718us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960676.219997:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:0.0:1786960676.225396:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960676.225924:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260864 00000100:00100000:1.0:1786960676.225942:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260864 00000100:00100000:1.0:1786960676.226027:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1786960676.226040:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5569:x1873763958260864:12345-192.168.203.23@tcp:101: 00010000:00010000:1.0:1786960676.226063:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960676.226086:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a200/0x1808d16e4c97f4b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bdc3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960676.226133:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a200/0x1808d16e4c97f4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdc3 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960676.226146:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a200/0x1808d16e4c97f4b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdc3 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960676.226158:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a200, rc 0) 00000100:00100000:1.0:1786960676.226264:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5569:x1873763958260864:12345-192.168.203.23@tcp:101: Request processed in 228us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960676.226272:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1786960676.230477:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960676.230623:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958260992 00000100:00100000:0.0:1786960676.230637:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958260992 00000100:00100000:0.0:1786960676.230695:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:0.0:1786960676.230705:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5569:x1873763958260992:12345-192.168.203.23@tcp:256: 20000000:01000000:0.0:1786960676.230728:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1786960676.230750:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786960676.230754:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786960676.230757:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1786960676.230760:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786960676.235436:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5569:x1873763958260992:12345-192.168.203.23@tcp:256: Request processed in 4723us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960676.235449:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:1.0:1786960676.267264:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.267419:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261120 00000100:00100000:3.0:1786960676.267428:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261120 00000100:00100000:3.0:1786960676.267477:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:3.0:1786960676.267486:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5569:x1873763958261120:12345-192.168.203.23@tcp:101: 00010000:00010000:3.0:1786960676.267503:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960676.267527:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bdca expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.267554:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.267566:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960676.267575:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168c00, rc 0) 00000100:00100000:3.0:1786960676.267627:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5569:x1873763958261120:12345-192.168.203.23@tcp:101: Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960676.267633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1786960676.279829:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960676.279863:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261248 00000100:00100000:0.0:1786960676.279872:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261248 00000100:00100000:0.0:1786960676.279932:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:0.0:1786960676.279942:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5569:x1873763958261248:12345-192.168.203.23@tcp:501: 00000100:00100000:0.0:1786960676.281398:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5569:x1873763958261248:12345-192.168.203.23@tcp:501: Request processed in 1452us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960676.281410:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:2.0:1786960676.288094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960676.288342:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261376 00000100:00100000:1.0:1786960676.288352:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261376 00000100:00100000:1.0:1786960676.288394:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1786960676.288403:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5569:x1873763958261376:12345-192.168.203.23@tcp:503: 00000100:00100000:1.0:1786960676.289999:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5569:x1873763958261376:12345-192.168.203.23@tcp:503: Request processed in 1592us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960676.290015:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:2.0:1786960676.303554:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960676.303687:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261504 00000100:00100000:1.0:1786960676.303696:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261504 00000100:00100000:1.0:1786960676.303749:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1786960676.303759:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5592:x1873763958261504:12345-192.168.203.23@tcp:502: 00000100:00100000:1.0:1786960676.304026:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5592:x1873763958261504:12345-192.168.203.23@tcp:502: Request processed in 267us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960676.304033:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1786960676.306957:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960676.309395:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261632 00000100:00100000:2.0:1786960676.309406:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261632 00000100:00100000:2.0:1786960676.309470:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:2.0:1786960676.309480:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5592:x1873763958261632:12345-192.168.203.23@tcp:502: 00000100:00100000:2.0:1786960676.309709:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5592:x1873763958261632:12345-192.168.203.23@tcp:502: Request processed in 230us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960676.309717:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:2.0:1786960676.314713:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960676.315463:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261760 00000100:00100000:3.0:1786960676.315472:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261760 00000100:00100000:3.0:1786960676.315513:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1786960676.315520:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1873763958261760:12345-192.168.203.23@tcp:38: 00010000:00080000:3.0:1786960676.315546:0:5810:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1786960676.315633:0:5810:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97f4c7 00000004:00100000:3.0:1786960676.315673:0:5810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1786960676.315678:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1786960676.370983:0:5810:0:(import.c:65:import_set_state_nolock()) ffff97667ab11800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960676.371063:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958261760:12345-192.168.203.23@tcp:38: Request processed in 55542us (56358us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960676.371074:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00010000:00010000:1.0:1786960677.108409:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960677.386119:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960677.386259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960677.386347:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262016 00000100:00100000:3.0:1786960677.386356:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262016 00000100:00100000:3.0:1786960677.386428:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958261888 00000100:00100000:3.0:1786960677.386431:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958261888 00000100:00100000:3.0:1786960677.386455:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960677.386465:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:5569:x1873763958262016:12345-192.168.203.23@tcp:41: 00000004:00000024:3.0:1786960677.386734:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786960677.386797:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:5569:x1873763958262016:12345-192.168.203.23@tcp:41: Request processed in 332us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960677.386805:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960677.386821:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1786960677.386828:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:0:x1873763958261888:12345-192.168.203.23@tcp:41: 00000004:00000024:3.0:1786960677.386839:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786960677.386859:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:0:x1873763958261888:12345-192.168.203.23@tcp:41: Request processed in 32us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960677.386865:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00080000:1.0:1786960677.386939:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960677.388644:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960677.388755:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262144 00000100:00100000:3.0:1786960677.388762:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262144 00000100:00100000:3.0:1786960677.388804:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1786960677.388813:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5569:x1873763958262144:12345-192.168.203.23@tcp:40: 00000100:00100000:3.0:1786960677.388875:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5569:x1873763958262144:12345-192.168.203.23@tcp:40: Request processed in 63us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960677.388883:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960677.394312:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960677.394400:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262656 00000100:00100000:3.0:1786960677.394424:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262656 00000100:00100000:3.0:1786960677.394477:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:3.0:1786960677.394495:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2341:x1873763958262656:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1786960677.394570:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2341:x1873763958262656:12345-192.168.203.23@tcp:400: Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960677.394577:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:0.0:1786960677.395723:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960677.395841:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262528 00000100:00100000:1.0:1786960677.395848:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262528 00000100:00100000:1.0:1786960677.395910:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1786960677.395920:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5569:x1873763958262528:12345-192.168.203.23@tcp:33: 00000100:00100000:2.0:1786960677.408223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960677.408253:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960677.408339:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262272 00000100:00100000:0.0:1786960677.408348:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262272 00000100:00100000:0.0:1786960677.408388:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262400 00000100:00100000:0.0:1786960677.408391:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262400 00000100:00100000:0.0:1786960677.408414:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1786960677.408422:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1873763958262272:12345-192.168.203.23@tcp:8: 00010000:00080000:0.0:1786960677.408460:0:6658:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1786960677.408498:0:6658:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97f4ce 00002000:00100000:0.0:1786960677.408510:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2d64e27-0ccc-4195-8812-2a972b8bf63c/ffff97667ac8f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786960677.408531:0:6658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786960677.409034:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786960677.409073:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667ac8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960677.409130:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958262272:12345-192.168.203.23@tcp:8: Request processed in 708us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960677.409138:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1786960677.409153:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1786960677.409158:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1873763958262400:12345-192.168.203.23@tcp:8: 00010000:00080000:0.0:1786960677.409173:0:6658:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1786960677.409219:0:6658:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97f4d5 00002000:00100000:0.0:1786960677.409238:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e2d64e27-0ccc-4195-8812-2a972b8bf63c/ffff97667ac8d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786960677.409252:0:6658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786960677.412773:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786960677.412813:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667ac8a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960677.412884:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958262400:12345-192.168.203.23@tcp:8: Request processed in 3720us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960677.412894:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000004:00080000:1.0:1786960677.468621:0:5813:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 72620us 00000004:00200000:0.0:1786960677.520945:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1786960677.521105:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5569:x1873763958262528:12345-192.168.203.23@tcp:33: Request processed in 125182us (125379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960677.521119:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1786960677.684724:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967720320:0@lo:400: 00000100:00100000:2.0:1786960677.684775:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967720704:0@lo:400: 00000100:00100000:1.0:1786960677.684808:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960677.684857:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960677.684885:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967720832:0@lo:400: 00000100:00100000:1.0:1786960677.684935:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960677.684941:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967720448:0@lo:400: 00000100:00100000:2.0:1786960677.684987:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960677.684997:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720320 00000100:00100000:1.0:1786960677.685005:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720320 00000100:00100000:2.0:1786960677.685015:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967720960:0@lo:400: 00000100:00100000:2.0:1786960677.685045:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960677.685069:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960677.685094:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967720576:0@lo:400: 00000100:00100000:2.0:1786960677.685118:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960677.685167:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720704 00000100:00100000:2.0:1786960677.685174:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720704 00000100:00100000:2.0:1786960677.685256:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720960 00000100:00100000:2.0:1786960677.685260:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720960 00000100:00100000:2.0:1786960677.685281:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960677.685291:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967720704:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685349:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967720704:12345-0@lo:400: Request processed in 59us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.685357:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960677.685374:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960677.685379:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967720960:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685411:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967720960:12345-0@lo:400: Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.685417:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960677.685439:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720832 00000100:00100000:2.0:1786960677.685443:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720832 00000100:00100000:2.0:1786960677.685463:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720448 00000100:00100000:2.0:1786960677.685466:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720448 00000100:00100000:2.0:1786960677.685475:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967720576 00000100:00100000:2.0:1786960677.685477:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967720576 00000100:00100000:2.0:1786960677.685490:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960677.685496:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967720832:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685534:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967720832:12345-0@lo:400: Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.685540:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960677.685551:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786960677.685557:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967720448:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685593:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967720448:12345-0@lo:400: Request processed in 36us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.685599:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786960677.685609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786960677.685616:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967720576:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685643:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967720576:12345-0@lo:400: Request processed in 29us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.685648:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1786960677.685664:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786960677.685669:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960677.685671:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786960677.685704:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45f80 x1873763967720704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960677.685719:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967720704:0@lo:400: 00010000:00080000:2.0:1786960677.685758:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45c00 x1873763967720576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960677.685768:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967720576:0@lo:400: 00000100:00100000:1.0:1786960677.685780:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00010000:00080000:2.0:1786960677.685786:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45180 x1873763967720448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960677.685798:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967720320:12345-0@lo:400: 00000100:00100000:2.0:1786960677.685804:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967720448:0@lo:400: 00010000:00080000:2.0:1786960677.685817:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b46680 x1873763967720960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960677.685828:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1786960677.685843:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967720960:0@lo:400: 00000100:00100000:1.0:1786960677.685873:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967720320:12345-0@lo:400: Request processed in 80us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960677.685883:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:2.0:1786960677.685917:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b46300 x1873763967720832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960677.685935:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967720832:0@lo:400: 00000100:00100000:2.0:1786960677.685953:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967720320:0@lo:400: 00000100:00100000:1.0:1786960677.688549:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960677.688570:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967721088:0@lo:13: 00000100:00100000:1.0:1786960677.688628:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960677.698327:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721088 00000100:00100000:3.0:1786960677.698341:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721088 00000100:00100000:3.0:1786960677.698413:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960677.698423:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967721088:12345-0@lo:13: 00002000:00000024:3.0:1786960677.698446:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960677.698834:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967721088:12345-0@lo:13: Request processed in 412us (10204us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960677.698842:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1786960677.699300:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976673ad1180 x1873763967721088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960677.699329:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967721088:0@lo:13: 00000100:00100000:1.0:1786960677.838422:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960677.838536:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262784 00000100:00100000:2.0:1786960677.838549:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262784 00000100:00100000:2.0:1786960677.838624:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960677.838635:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5609:x1873763958262784:12345-192.168.203.23@tcp:101: 00010000:00010000:2.0:1786960677.838661:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960677.838936:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97f4dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bdf4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839019:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839031:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839045:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960677.839272:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786960677.839276:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960677.839357:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839383:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97f4dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdf4 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839412:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdf4 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960677.839420:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976664f8c400) 00010000:00010000:2.0:1786960677.839423:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786960677.839426:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044800, rc 0) 00000100:00100000:2.0:1786960677.839494:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:5609:x1873763958262784:12345-192.168.203.23@tcp:101: Request processed in 860us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960677.839502:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00010000:00010000:2.0:1786960678.135181:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960678.197288:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967721216:0@lo:13: 00000100:00100000:2.0:1786960678.197380:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960678.197637:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721216 00000100:00100000:3.0:1786960678.197648:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721216 00000100:00100000:3.0:1786960678.197716:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786960678.197727:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967721216:12345-0@lo:13: 00002000:00000024:3.0:1786960678.197758:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960678.197838:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967721216:12345-0@lo:13: Request processed in 112us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960678.197845:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1786960678.200244:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743a9500 x1873763967721216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960678.200281:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967721216:0@lo:13: 00010000:00010000:1.0:1786960679.159347:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960680.180389:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960680.280497:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960680.280650:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958262912 00000100:00100000:2.0:1786960680.280663:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958262912 00000100:00100000:2.0:1786960680.280751:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1786960680.280765:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:5662:x1873763958262912:12345-192.168.203.23@tcp:41: 00000004:00000024:2.0:1786960680.280822:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786960680.280918:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:5662:x1873763958262912:12345-192.168.203.23@tcp:41: Request processed in 156us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960680.280926:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:1.0:1786960680.281155:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960680.288964:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960680.289148:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263040 00000100:00100000:3.0:1786960680.289161:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263040 00000100:00100000:3.0:1786960680.289295:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1786960680.289308:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5662:x1873763958263040:12345-192.168.203.23@tcp:13: 00002000:00000024:3.0:1786960680.289362:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960680.289472:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5662:x1873763958263040:12345-192.168.203.23@tcp:13: Request processed in 166us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960680.289481:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00080000:1.0:1786960680.289810:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960680.292714:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960680.292812:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263168 00000100:00100000:3.0:1786960680.292825:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263168 00000100:00100000:3.0:1786960680.292917:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960680.292929:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5662:x1873763958263168:12345-192.168.203.23@tcp:13: 00002000:00000024:3.0:1786960680.292980:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960680.293062:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:5662:x1873763958263168:12345-192.168.203.23@tcp:13: Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960680.293070:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:1.0:1786960680.293247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786960681.205346:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960681.808916:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000001:00100000:0.0:1786960681.811010:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00010000:00010000:2.0:1786960682.229629:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786960682.415431:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000100:00100000:0.0:1786960682.649330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960682.649373:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960682.649416:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960682.649440:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960682.649469:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263680 00000100:00100000:0.0:1786960682.649489:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263680 00000100:00100000:0.0:1786960682.649545:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263552 00000100:00100000:0.0:1786960682.649548:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263552 00000100:00100000:0.0:1786960682.649567:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1786960682.649590:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958263680:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1786960682.649694:0:6660:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1786960682.649704:0:6660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1786960682.649829:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1786960682.649838:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958263552:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1786960682.649912:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958263552:12345-192.168.203.23@tcp:400: Request processed in 75us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.649919:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1786960682.650090:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263424 00000100:00100000:2.0:1786960682.650096:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263424 00000100:00100000:2.0:1786960682.650135:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1786960682.650143:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958263424:12345-192.168.203.23@tcp:400: 00000100:00100000:2.0:1786960682.650181:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958263424:12345-192.168.203.23@tcp:400: Request processed in 39us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960682.650216:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1786960682.650236:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263296 00000100:00100000:2.0:1786960682.650240:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263296 00000100:00100000:0.0:1786960682.650313:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958263680:12345-192.168.203.23@tcp:400: Request processed in 725us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960682.650319:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00080000:0.0:1786960682.650336:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960682.650341:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960682.650343:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960682.659356:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1786960682.659377:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958263296:12345-192.168.203.23@tcp:400: 00000100:00100000:2.0:1786960682.659488:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958263296:12345-192.168.203.23@tcp:400: Request processed in 118us (10070us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960682.659495:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:3.0:1786960682.804674:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967721728:0@lo:400: 00000100:00100000:3.0:1786960682.804749:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.804802:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786960682.804808:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967721344:0@lo:400: 00000100:00100000:3.0:1786960682.804835:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.804858:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967721856:0@lo:400: 00000100:00100000:3.0:1786960682.804918:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.804946:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967721472:0@lo:400: 00000100:00100000:3.0:1786960682.804968:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.804987:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967721984:0@lo:400: 00000100:00100000:3.0:1786960682.805012:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.805030:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960682.805036:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967721600:0@lo:400: 00000100:00100000:3.0:1786960682.805058:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960682.805427:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721728 00000100:00100000:3.0:1786960682.805436:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721728 00000100:00100000:3.0:1786960682.805504:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721984 00000100:00100000:3.0:1786960682.805507:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721984 00000100:00100000:3.0:1786960682.805532:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786960682.805542:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967721728:12345-0@lo:400: 00000100:00100000:3.0:1786960682.805598:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967721728:12345-0@lo:400: Request processed in 57us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.805606:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786960682.805623:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786960682.805629:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967721984:12345-0@lo:400: 00000100:00100000:3.0:1786960682.805754:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967721984:12345-0@lo:400: Request processed in 125us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.805762:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786960682.805783:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721344 00000100:00100000:3.0:1786960682.805786:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721344 00000100:00100000:3.0:1786960682.805814:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1786960682.805820:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967721344:12345-0@lo:400: 00000100:00100000:3.0:1786960682.805852:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967721344:12345-0@lo:400: Request processed in 32us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.805927:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1786960682.805957:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721856 00000100:00100000:3.0:1786960682.805961:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721856 00000100:00100000:3.0:1786960682.805980:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721472 00000100:00100000:3.0:1786960682.805983:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721472 00000100:00100000:3.0:1786960682.805992:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967721600 00000100:00100000:3.0:1786960682.805994:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967721600 00000100:00100000:3.0:1786960682.806006:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786960682.806013:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967721856:12345-0@lo:400: 00000100:00100000:3.0:1786960682.806044:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967721856:12345-0@lo:400: Request processed in 32us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.806051:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786960682.806063:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960682.806069:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967721472:12345-0@lo:400: 00000100:00080000:0.0:1786960682.806171:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960682.806176:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786960682.806178:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960682.807421:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967721472:12345-0@lo:400: Request processed in 1347us (2447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.807432:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960682.808941:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960682.808968:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967721600:12345-0@lo:400: 00000100:00100000:3.0:1786960682.809043:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967721600:12345-0@lo:400: Request processed in 85us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960682.809050:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960682.809615:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967721600:0@lo:400: 00000100:00100000:3.0:1786960682.809631:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967721472:0@lo:400: 00010000:00080000:3.0:1786960682.810258:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743abb80 x1873763967721984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960682.810289:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967721984:0@lo:400: 00000100:00100000:3.0:1786960682.810340:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967721344:0@lo:400: 00000100:00100000:3.0:1786960682.810354:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967721856:0@lo:400: 00010000:00080000:3.0:1786960682.810367:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743a8700 x1873763967721728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960682.810376:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967721728:0@lo:400: 00000100:00100000:3.0:1786960682.813770:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967722112:0@lo:13: 00000100:00100000:3.0:1786960682.813847:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960682.814045:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967722112 00000100:00100000:0.0:1786960682.814055:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967722112 00000100:00100000:0.0:1786960682.814117:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786960682.814129:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967722112:12345-0@lo:13: 00002000:00000024:0.0:1786960682.814172:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960682.814250:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967722112:12345-0@lo:13: Request processed in 123us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960682.814258:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1786960682.814413:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766816e2680 x1873763967722112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960682.814431:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967722112:0@lo:13: 00000001:02000400:3.0:1786960683.224516:0:8268:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1786960683.252275:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960683.316842:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967722240:0@lo:13: 00000100:00100000:1.0:1786960683.316921:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960683.316993:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967722240 00000100:00100000:1.0:1786960683.317011:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967722240 00000100:00100000:1.0:1786960683.317062:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786960683.317071:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967722240:12345-0@lo:13: 00002000:00000024:1.0:1786960683.317106:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960683.317152:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967722240:12345-0@lo:13: Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960683.317159:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1786960683.317216:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743ab100 x1873763967722240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960683.317247:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967722240:0@lo:13: 00010000:00010000:2.0:1786960684.276386:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960685.300599:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960686.324361:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960687.348372:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786960687.677377:0:8417:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1e5f23a0 20000000:00000080:3.0:1786960687.677404:0:8417:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff976677198000 uarg=0000000000000000 20000000:01000000:3.0:1786960687.677455:0:8417:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1786960687.677458:0:8417:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1786960687.677462:0:8417:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1786960687.677479:0:8417:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1786960687.677486:0:8417:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1786960687.677505:0:8417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786960687.677508:0:8417:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1786960687.678003:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1786960687.678007:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786960687.682258:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1786960687.686487:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1786960687.686554:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1786960687.686584:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1786960687.686598:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1786960687.686601:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1786960687.688105:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1786960687.688669:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1786960687.688728:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1786960687.688756:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1786960687.688770:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1786960687.688773:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1786960687.690977:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1786960687.694992:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1786960687.695067:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1786960687.695132:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1786960687.695154:0:8417:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1786960687.695158:0:8417:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786960687.697626:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1786960687.698543:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1786960687.698610:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1786960687.698641:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1786960687.698658:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1786960687.698800:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698821:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698853:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698861:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698868:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698935:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698942:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698950:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698960:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698967:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.698975:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699021:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699049:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 9 pid: 5804 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699069:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722368:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960687.699289:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699297:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 9 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699306:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722496:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960687.699339:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699349:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 18 pid: 5803 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699359:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722624:0@lo:104: 00000100:00100000:2.0:1786960687.699411:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960687.699455:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699463:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 18 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699536:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722752:0@lo:104: 00000100:00100000:2.0:1786960687.699564:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960687.699595:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699604:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 18 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699613:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722880:0@lo:104: 00010000:00010000:2.0:1786960687.699633:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.699641:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 18 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.699648:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723008:0@lo:104: 00010000:00010000:2.0:1786960687.699665:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.699901:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786960687.699924:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.699938:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.699948:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967722624 00000100:00100000:1.0:1786960687.699956:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967722624 00000100:00100000:1.0:1786960687.700000:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967722752 00000100:00100000:1.0:1786960687.700003:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967722752 00000100:00100000:1.0:1786960687.700013:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967722880 00000100:00100000:1.0:1786960687.700015:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967722880 00000100:00100000:1.0:1786960687.700023:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723008 00000100:00100000:1.0:1786960687.700025:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723008 00000100:00100000:1.0:1786960687.700039:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960687.700048:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+6:8417:x1873763967722624:12345-0@lo:104: 00010000:00010000:1.0:1786960687.700063:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700122:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960687.700128:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+6:8417:x1873763967722624:12345-0@lo:104: Request processed in 82us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.700136:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960687.700153:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960687.700159:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:8417:x1873763967722752:12345-0@lo:104: 00010000:00010000:1.0:1786960687.700167:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700219:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786960687.700231:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:8417:x1873763967722752:12345-0@lo:104: Request processed in 73us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.700237:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960687.700269:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960687.700275:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8417:x1873763967722880:12345-0@lo:104: 00010000:00010000:1.0:1786960687.700283:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700309:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1786960687.700314:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8417:x1873763967722880:12345-0@lo:104: Request processed in 40us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.700321:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960687.700332:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960687.700338:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967723008:12345-0@lo:104: 00010000:00010000:1.0:1786960687.700345:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700369:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1786960687.700373:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967723008:12345-0@lo:104: Request processed in 37us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.700378:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1786960687.700397:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786960687.700405:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700413:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0e00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.700417:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700437:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.700445:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.700452:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.700496:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700504:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.700526:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700533:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f49d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700549:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786960687.700553:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700559:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045000 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.700562:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700568:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.700575:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.700585:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.700598:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700604:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.700618:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700625:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c97f46c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f473 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700634:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786960687.700636:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700642:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.700645:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700652:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.700658:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.700663:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.700671:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700675:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.700696:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700702:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169ac00/0x1808d16e4c97f450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f457 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700712:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960687.700714:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700720:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044e00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.700723:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700730:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.700736:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.700740:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.700749:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700754:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.700758:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700764:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682044e00/0x1808d16e4c97f442 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f449 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.700773:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.700778:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.700780:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.700786:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960687.700809:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967723264:0@lo:103: 00000100:00100000:1.0:1786960687.700852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.700879:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960687.700884:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967723648:0@lo:103: 00000100:00100000:1.0:1786960687.700904:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.700932:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967723392:0@lo:103: 00000100:00100000:1.0:1786960687.700954:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.700972:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960687.700977:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967723520:0@lo:103: 00000100:00100000:1.0:1786960687.701017:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960687.701052:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723264 00000100:00100000:1.0:1786960687.701057:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723264 00010000:00010000:1.0:1786960687.701079:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 19 pid: 5803 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.701095:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723648 00000100:00100000:1.0:1786960687.701098:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723648 00010000:00010000:1.0:1786960687.701109:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 20 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.701119:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723392 00000100:00100000:1.0:1786960687.701122:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723392 00010000:00010000:1.0:1786960687.701131:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 21 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.701140:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723520 00000100:00100000:1.0:1786960687.701143:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723520 00010000:00010000:1.0:1786960687.701159:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 22 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.701173:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960687.701180:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+22:3286:x1873763967723264:12345-0@lo:103: 00010000:00010000:1.0:1786960687.701217:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.701223:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 22 pid: 5803 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.701591:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 22 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.701603:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723136:0@lo:104: 00000100:00100000:2.0:1786960687.701638:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786960687.701681:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 22 pid: 5803 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701705:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.701741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+22:3286:x1873763967723264:12345-0@lo:103: Request processed in 561us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.701749:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960687.701774:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960687.701781:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+21:3286:x1873763967723648:12345-0@lo:103: 00010000:00010000:1.0:1786960687.701790:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.701795:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 21 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701803:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 21 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701813:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.701848:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+21:3286:x1873763967723648:12345-0@lo:103: Request processed in 67us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.701854:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960687.701886:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960687.701892:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3287:x1873763967723392:12345-0@lo:103: 00010000:00010000:1.0:1786960687.701900:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.701905:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 20 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701914:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 20 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701923:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.701950:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3287:x1873763967723392:12345-0@lo:103: Request processed in 58us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.701956:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960687.701969:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960687.701975:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967723520:12345-0@lo:103: 00010000:00010000:1.0:1786960687.701983:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.701988:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 19 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.701996:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 19 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702005:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.702027:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967723520:12345-0@lo:103: Request processed in 51us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.702033:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960687.702093:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967723520:0@lo:103: 00000100:00100000:1.0:1786960687.702104:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967723392:0@lo:103: 00000100:00100000:1.0:1786960687.702149:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967723648:0@lo:103: 00000100:00100000:1.0:1786960687.702158:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967723264:0@lo:103: 00000100:00100000:1.0:1786960687.702179:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723136 00000100:00100000:1.0:1786960687.702204:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723136 00000100:00100000:1.0:1786960687.702231:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786960687.702238:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967723136:12345-0@lo:104: 00010000:00010000:1.0:1786960687.702249:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702290:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960687.702295:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967723136:12345-0@lo:104: Request processed in 59us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.702301:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1786960687.702319:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960687.702327:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702335:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168400 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.702339:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702348:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.702356:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.702361:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.702402:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702409:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.702426:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702433:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168400/0x1808d16e4c97f434 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f43b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.702466:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.702792:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.702795:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960687.702806:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960687.702823:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967723776:0@lo:103: 00000100:00100000:1.0:1786960687.702932:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960687.703107:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.703121:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 18 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703133:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723904:0@lo:104: 00000100:00100000:2.0:1786960687.703162:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960687.703222:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960687.703231:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 18 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703240:0:8417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967724032:0@lo:104: 00000100:00100000:2.0:1786960687.703262:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960687.703280:0:8417:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420b40 going to sleep for 11 seconds 00010000:00010000:2.0:1786960687.703297:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168000/0x1808d16e4c97f49d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f496 expref: 18 pid: 5803 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703313:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722624:0@lo:104: 00010000:00010000:2.0:1786960687.703324:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169be00/0x1808d16e4c97f473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f46c expref: 17 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703336:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722752:0@lo:104: 00010000:00010000:2.0:1786960687.703347:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045c00/0x1808d16e4c97f457 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f450 expref: 16 pid: 5805 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703356:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722880:0@lo:104: 00010000:00010000:2.0:1786960687.703365:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a400/0x1808d16e4c97f449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f442 expref: 15 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960687.703375:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723008:0@lo:104: 00000100:00100000:2.0:1786960687.703382:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723136:0@lo:104: 00000100:00100000:1.0:1786960687.703450:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723904 00000100:00100000:1.0:1786960687.703457:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723904 00000100:00100000:1.0:1786960687.703491:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724032 00000100:00100000:1.0:1786960687.703494:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724032 00000100:00100000:1.0:1786960687.703508:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786960687.703516:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8417:x1873763967723904:12345-0@lo:104: 00010000:00010000:1.0:1786960687.703526:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.703572:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960687.703577:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8417:x1873763967723904:12345-0@lo:104: Request processed in 62us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.703584:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786960687.703597:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786960687.703610:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967724032:12345-0@lo:104: 00010000:00010000:1.0:1786960687.703618:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.703650:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786960687.703655:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8417:x1873763967724032:12345-0@lo:104: Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.703661:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1786960687.704030:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786960687.704037:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704045:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.704049:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704059:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.704066:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.704072:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.704100:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704106:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.704123:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704142:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e1800/0x1808d16e4c97f40a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f411 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704154:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960687.704157:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704164:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960687.704167:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704174:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960687.704180:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960687.704209:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960687.704224:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704230:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960687.704236:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704243:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f3e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f3e7 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.704258:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.704265:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960687.704267:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960687.704281:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967724288:0@lo:103: 00000100:00100000:1.0:1786960687.704316:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960687.704405:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967723904:0@lo:104: 00000100:00100000:2.0:1786960687.704414:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967724032:0@lo:104: 00000100:00100000:1.0:1786960687.705709:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960687.705726:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967724160:0@lo:103: 00000100:00100000:1.0:1786960687.705773:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.706019:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967723776 00000100:00100000:3.0:1786960687.706030:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967723776 00010000:00010000:3.0:1786960687.706084:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 15 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960687.706116:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724288 00000100:00100000:3.0:1786960687.706120:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724288 00010000:00010000:3.0:1786960687.706133:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 16 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960687.706152:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960687.706161:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3285:x1873763967723776:12345-0@lo:103: 00010000:00010000:3.0:1786960687.706177:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960687.706182:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 16 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706216:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 16 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706237:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168800/0x1808d16e4c97f43b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f434 expref: 16 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706284:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960687.706328:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+15:3285:x1873763967723776:12345-0@lo:103: Request processed in 167us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.706336:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960687.706353:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960687.706359:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:3288:x1873763967724288:12345-0@lo:103: 00010000:00010000:3.0:1786960687.706367:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960687.706371:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 14 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706378:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 14 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706387:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a800/0x1808d16e4c97f3e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f3e0 expref: 14 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.706398:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960687.706420:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3288:x1873763967724288:12345-0@lo:103: Request processed in 62us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.706427:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786960687.706695:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967724288:0@lo:103: 00000100:00100000:1.0:1786960687.706729:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724160 00000100:00100000:1.0:1786960687.706734:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724160 00010000:00010000:1.0:1786960687.706750:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 13 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.706766:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786960687.706773:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+13:3288:x1873763967724160:12345-0@lo:103: 00010000:00010000:1.0:1786960687.706780:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.706785:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 13 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.706793:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 13 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.706804:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a000/0x1808d16e4c97f411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f40a expref: 13 pid: 5804 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.706814:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.706853:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+12:3288:x1873763967724160:12345-0@lo:103: Request processed in 81us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.706858:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786960687.707116:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967723776:0@lo:103: 00000100:00100000:1.0:1786960687.707143:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967724160:0@lo:103: 00000100:00100000:1.0:1786960687.708006:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960687.708025:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960687.708044:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263936 00000100:00100000:1.0:1786960687.708051:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263936 00010000:00010000:1.0:1786960687.708085:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 10 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.708107:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958263808 00000100:00100000:1.0:1786960687.708110:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958263808 00010000:00010000:1.0:1786960687.708121:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 11 pid: 5804 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960687.708134:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1786960687.708143:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2344:x1873763958263936:12345-192.168.203.23@tcp:103: 00010000:00010000:1.0:1786960687.708156:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.708161:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 11 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708172:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 11 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708209:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.708257:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2344:x1873763958263936:12345-192.168.203.23@tcp:103: Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.708264:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1786960687.708278:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1786960687.708293:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958263808:12345-192.168.203.23@tcp:103: 00010000:00010000:1.0:1786960687.708301:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960687.708306:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 10 pid: 5804 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708316:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 10 pid: 5804 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708329:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708337:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708354:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708362:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708369:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708377:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708384:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960687.708388:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708398:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708415:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960687.708428:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960687.708448:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958263808:12345-192.168.203.23@tcp:103: Request processed in 155us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.708455:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00010000:00010000:0.0:1786960687.709544:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960687.710135:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169400/0x1808d16e4c97f4b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd99 expref: 9 pid: 5804 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960687.710162:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722368:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960687.710179:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f4ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bd92 expref: 8 pid: 5803 timeout: 269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960687.710342:0:8417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8417:1873763967722496:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960687.710439:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.710451:0:8417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.710458:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960687.710464:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045400/0x1808d16e4c97f4ea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960687.766310:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960687.766388:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960687.766428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960687.766480:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264064 00000100:00100000:1.0:1786960687.766492:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264064 00000100:00100000:1.0:1786960687.766579:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1786960687.766590:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958264064:12345-192.168.203.23@tcp:400: 00000100:00100000:1.0:1786960687.766698:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958264064:12345-192.168.203.23@tcp:400: Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960687.766706:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00080000:0.0:1786960687.774205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960687.781586:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264192 00000100:00100000:3.0:1786960687.781608:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264192 00000100:00100000:3.0:1786960687.781817:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264320 00000100:00100000:3.0:1786960687.781822:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264320 00000100:00100000:3.0:1786960687.781879:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960687.781892:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958264192:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1786960687.782167:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958264192:12345-192.168.203.23@tcp:400: Request processed in 277us (15985us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.782177:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960687.782222:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1786960687.782231:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958264320:12345-192.168.203.23@tcp:400: 00000100:00100000:3.0:1786960687.782257:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958264320:12345-192.168.203.23@tcp:400: Request processed in 28us (15829us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.782263:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:2.0:1786960687.782512:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960687.782519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960687.924969:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967724416:0@lo:400: 00000100:00100000:3.0:1786960687.925062:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.925147:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967724928:0@lo:400: 00000100:00100000:3.0:1786960687.925177:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.925236:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786960687.925243:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967724544:0@lo:400: 00000100:00100000:3.0:1786960687.925267:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.925300:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967724672:0@lo:400: 00000100:00100000:3.0:1786960687.925325:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.925345:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960687.925351:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967724800:0@lo:400: 00000100:00100000:3.0:1786960687.925372:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.925406:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724416 00000100:00100000:3.0:1786960687.925415:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724416 00000100:00100000:3.0:1786960687.925459:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724544 00000100:00100000:3.0:1786960687.925463:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724544 00000100:00100000:3.0:1786960687.925487:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724800 00000100:00100000:3.0:1786960687.925489:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724800 00000100:00100000:3.0:1786960687.925507:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960687.925517:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967724416:12345-0@lo:400: 00000100:00100000:3.0:1786960687.925580:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967724416:12345-0@lo:400: Request processed in 63us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.925588:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960687.925608:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786960687.925615:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967724544:12345-0@lo:400: 00000100:00100000:3.0:1786960687.925643:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967724544:12345-0@lo:400: Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.925650:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786960687.925661:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1786960687.926286:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960687.926522:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967725056:0@lo:13: 00000100:00100000:1.0:1786960687.926570:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960687.926969:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967724800:12345-0@lo:400: 00000100:00100000:2.0:1786960687.927101:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725056 00000100:00100000:2.0:1786960687.927108:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725056 00000100:00100000:2.0:1786960687.927162:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786960687.927170:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967725056:12345-0@lo:13: 00002000:00000024:2.0:1786960687.927233:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960687.927281:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967725056:12345-0@lo:13: Request processed in 111us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960687.927288:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1786960687.927311:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786960687.927341:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b9c00 x1873763967725056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960687.927363:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967725056:0@lo:13: 00000100:00100000:3.0:1786960687.927896:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967724800:12345-0@lo:400: Request processed in 2226us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.927906:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786960687.927936:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724928 00000100:00100000:3.0:1786960687.927942:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724928 00000100:00100000:3.0:1786960687.927986:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967724672 00000100:00100000:3.0:1786960687.927990:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967724672 00000100:00100000:3.0:1786960687.928012:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960687.928019:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967724928:12345-0@lo:400: 00000100:00100000:3.0:1786960687.928060:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967724928:12345-0@lo:400: Request processed in 42us (2882us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.928067:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960687.928078:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960687.928084:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967724672:12345-0@lo:400: 00000100:00100000:3.0:1786960687.928112:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967724672:12345-0@lo:400: Request processed in 28us (2786us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960687.928118:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960687.928172:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967724544:0@lo:400: 00000100:00100000:3.0:1786960687.928214:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967724416:0@lo:400: 00010000:00080000:3.0:1786960687.928230:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743a8380 x1873763967724928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960687.928241:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967724928:0@lo:400: 00000100:00080000:2.0:1786960687.928369:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960687.939121:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967724800:0@lo:400: 00010000:00080000:0.0:1786960687.939304:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766743aaa00 x1873763967724672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960687.939319:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967724672:0@lo:400: 00010000:00010000:1.0:1786960688.372756:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960688.437216:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960688.437251:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967725184:0@lo:13: 00000100:00100000:1.0:1786960688.437342:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960688.437522:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725184 00000100:00100000:2.0:1786960688.437532:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725184 00000100:00100000:2.0:1786960688.437810:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786960688.437836:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967725184:12345-0@lo:13: 00002000:00000024:2.0:1786960688.437884:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960688.437961:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967725184:12345-0@lo:13: Request processed in 140us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960688.437968:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1786960688.440020:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45c00 x1873763967725184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960688.440544:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967725184:0@lo:13: 10000000:01000000:1.0:1786960689.396421:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786960689.396454:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9766772e6000 from 39 10000000:01000000:1.0:1786960689.396462:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960689.396522:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.396536:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.396550:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960689.396581:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725312:0@lo:101: 00000100:00100000:1.0:1786960689.396672:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.396741:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4540 going to sleep for 11 seconds 00010000:00010000:0.0:1786960689.396809:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960689.396890:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725312 00000100:00100000:3.0:1786960689.396901:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725312 00000100:00100000:3.0:1786960689.396976:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1786960689.396986:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+12:5807:x1873763967725312:12345-0@lo:101: 00010000:00010000:3.0:1786960689.397010:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960689.397026:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682169400/0x1808d16e4c97f4f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f4f1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.397063:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682169400/0x1808d16e4c97f4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f4f1 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.397075:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682169400/0x1808d16e4c97f4f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f4f1 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.397086:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169400, rc 0) 00000100:00100000:3.0:1786960689.397137:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725312:12345-0@lo:101: Request processed in 152us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.397145:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1786960689.397325:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725312:0@lo:101: 00010000:00010000:1.0:1786960689.397341:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.397350:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960689.397410:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725440:0@lo:501: 00000100:00100000:1.0:1786960689.397439:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.397467:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.397541:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725440 00000100:00100000:0.0:1786960689.397546:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725440 00000100:00100000:0.0:1786960689.397581:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1786960689.397589:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725440:12345-0@lo:501: 00000100:00100000:0.0:1786960689.397895:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725440:12345-0@lo:501: Request processed in 305us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.397903:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1786960689.398059:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725440:0@lo:501: 00000100:00100000:1.0:1786960689.398089:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725568:0@lo:503: 00000100:00100000:1.0:1786960689.398129:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.398149:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4540 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.398257:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725568 00000100:00100000:0.0:1786960689.398261:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725568 00000100:00100000:0.0:1786960689.398290:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1786960689.398297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725568:12345-0@lo:503: 00000100:00100000:0.0:1786960689.398454:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725568:12345-0@lo:503: Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.398460:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1786960689.398534:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725568:0@lo:503: 00000100:00100000:1.0:1786960689.399285:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8433:1873763967725696:0@lo:502: 00000100:00100000:1.0:1786960689.399334:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.399373:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.399549:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725696 00000100:00100000:0.0:1786960689.399556:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725696 00000100:00100000:0.0:1786960689.399593:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1786960689.399602:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:8433:x1873763967725696:12345-0@lo:502: 00000100:00100000:0.0:1786960689.399852:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:8433:x1873763967725696:12345-0@lo:502: Request processed in 250us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.399860:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786960689.400286:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8433:1873763967725696:0@lo:502: 00000100:00100000:3.0:1786960689.400347:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8433:1873763967725824:0@lo:502: 00000100:00100000:3.0:1786960689.400395:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.400427:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565240 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.400478:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725824 00000100:00100000:0.0:1786960689.400483:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725824 00000100:00100000:0.0:1786960689.400519:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1786960689.400528:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:8433:x1873763967725824:12345-0@lo:502: 00000100:00100000:0.0:1786960689.400706:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:8433:x1873763967725824:12345-0@lo:502: Request processed in 180us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.400721:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1786960689.401377:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8433:1873763967725824:0@lo:502: 00000040:00080000:3.0:1786960689.401404:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1786960689.401693:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1786960689.401713:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786960689.401727:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.401740:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960689.401751:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1786960689.401753:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1786960689.401757:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1786960689.401798:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.401809:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.401830:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960689.401851:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725952:0@lo:101: 00000100:00100000:0.0:1786960689.401894:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960689.402781:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670c180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.411633:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967725952 00000100:00100000:1.0:1786960689.411653:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967725952 00000100:00100000:1.0:1786960689.411732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1786960689.411745:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+13:5807:x1873763967725952:12345-0@lo:101: 00010000:00010000:1.0:1786960689.411767:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960689.411791:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6000/0x1808d16e4c97f506 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f4ff expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.411837:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6000/0x1808d16e4c97f506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f4ff expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.411851:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6000/0x1808d16e4c97f506 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f4ff expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.411861:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6000, rc 0) 00000100:00100000:1.0:1786960689.412704:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967725952:12345-0@lo:101: Request processed in 958us (10805us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.412713:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1786960689.431668:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967725952:0@lo:101: 00010000:00010000:0.0:1786960689.431717:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.431733:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960689.431870:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726080:0@lo:501: 00000100:00100000:0.0:1786960689.431946:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960689.432013:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670c180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.432269:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726080 00000100:00100000:1.0:1786960689.432277:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726080 00000100:00100000:1.0:1786960689.432337:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1786960689.432348:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967726080:12345-0@lo:501: 00000100:00100000:1.0:1786960689.432693:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967726080:12345-0@lo:501: Request processed in 345us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.432711:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1786960689.436415:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726080:0@lo:501: 00000100:00100000:0.0:1786960689.436505:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726208:0@lo:503: 00000100:00100000:0.0:1786960689.436609:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960689.436661:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670c180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.436743:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726208 00000100:00100000:1.0:1786960689.436752:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726208 00000100:00100000:1.0:1786960689.436815:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1786960689.436835:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967726208:12345-0@lo:503: 00000100:00100000:1.0:1786960689.437101:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967726208:12345-0@lo:503: Request processed in 267us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.437109:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1786960689.437370:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726208:0@lo:503: 00000100:00100000:3.0:1786960689.437911:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8434:1873763967726336:0@lo:502: 00000100:00100000:3.0:1786960689.437968:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.437999:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960689.438161:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726336 00000100:00100000:2.0:1786960689.438168:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726336 00000100:00100000:2.0:1786960689.438231:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1786960689.438241:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8434:x1873763967726336:12345-0@lo:502: 00000100:00100000:2.0:1786960689.438440:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8434:x1873763967726336:12345-0@lo:502: Request processed in 200us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960689.438447:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1786960689.438594:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8434:1873763967726336:0@lo:502: 00000020:01000000:3.0:1786960689.438622:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960689.438634:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960689.438643:0:8434:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786960689.438649:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786960689.438674:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8434:1873763967726464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.438709:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.438743:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.438795:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726464 00000100:00100000:0.0:1786960689.438800:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726464 00000100:00100000:0.0:1786960689.438840:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1786960689.438847:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8434:x1873763967726464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960689.438989:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:8434:x1873763967726464:12345-0@lo:502:llog_process_th.0 Request processed in 142us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.438997:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1786960689.439280:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8434:1873763967726464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960689.439299:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960689.439303:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960689.439305:0:8434:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786960689.439309:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1786960689.439542:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1786960689.439574:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786960689.439586:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.439598:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960689.439609:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786960689.439612:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97667ad21800 from 39 10000000:01000000:1.0:1786960689.439615:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960689.439645:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.439653:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.439663:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960689.439680:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.439721:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.439753:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.439806:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726592 00000100:00100000:0.0:1786960689.439810:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726592 00000100:00100000:0.0:1786960689.439854:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1786960689.439862:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+14:5807:x1873763967726592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960689.439871:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960689.439887:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f50d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.439913:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f50d expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.439932:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f50d expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.439941:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1200, rc 0) 00000100:00100000:0.0:1786960689.439991:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967726592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.439998:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786960689.440169:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960689.440212:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960689.440223:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960689.440276:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.440304:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960689.440323:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.441092:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726720 00000100:00100000:3.0:1786960689.441103:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726720 00000100:00100000:3.0:1786960689.441334:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1786960689.441345:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967726720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.441671:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967726720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960689.441737:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.441784:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.441844:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960689.441867:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.446434:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726848 00000100:00100000:1.0:1786960689.446456:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726848 00000100:00100000:3.0:1786960689.455804:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786960689.456053:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786960689.456074:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967726848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.456429:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967726848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (14584us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960689.456437:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1786960689.456715:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967726848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.456997:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8435:1873763967726976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.457058:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.457088:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967726976 00000100:00100000:3.0:1786960689.457094:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967726976 00000100:00100000:3.0:1786960689.457125:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786960689.457133:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8435:x1873763967726976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.457543:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8435:x1873763967726976:12345-0@lo:502:llog_process_th.0 Request processed in 410us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.457562:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1786960689.457611:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.457625:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8435:1873763967726976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.457666:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8435:1873763967727104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.457698:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.457716:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727104 00000100:00100000:3.0:1786960689.457720:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727104 00000100:00100000:3.0:1786960689.457736:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1786960689.457742:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8435:x1873763967727104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.457869:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:8435:x1873763967727104:12345-0@lo:502:llog_process_th.0 Request processed in 126us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.457876:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1786960689.457903:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.457915:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8435:1873763967727104:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786960689.457933:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786960689.457991:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1786960689.458011:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786960689.458022:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.458033:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960689.458687:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1786960689.458691:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1786960689.458695:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786960689.458735:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.458744:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.458755:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960689.458775:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.458812:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.459141:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.459416:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727232 00000100:00100000:1.0:1786960689.459425:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727232 00000100:00100000:2.0:1786960689.472671:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1786960689.472736:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+15:5807:x1873763967727232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960689.472780:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960689.472805:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045c00/0x1808d16e4c97f522 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f51b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960689.473100:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045c00/0x1808d16e4c97f522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f51b expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960689.473116:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045c00/0x1808d16e4c97f522 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f51b expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960689.473127:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045c00, rc 0) 00000100:00100000:2.0:1786960689.473954:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1261us (15136us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960689.473975:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786960689.481422:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960689.481472:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.481488:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960689.481742:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.481835:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960689.481880:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.482363:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727360 00000100:00100000:1.0:1786960689.482372:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727360 00000100:00100000:1.0:1786960689.482435:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1786960689.482446:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.482781:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.482789:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1786960689.482904:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.482952:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960689.483003:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960689.483034:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.483089:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727488 00000100:00100000:3.0:1786960689.483094:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727488 00000100:00100000:3.0:1786960689.483127:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786960689.483135:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.483368:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.483375:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1786960689.483662:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.484288:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8436:1873763967727616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960689.484336:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.484366:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.484534:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727616 00000100:00100000:3.0:1786960689.484541:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727616 00000100:00100000:3.0:1786960689.484576:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786960689.484583:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8436:x1873763967727616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.484787:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8436:x1873763967727616:12345-0@lo:502:llog_process_th.0 Request processed in 203us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.484794:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1786960689.485062:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8436:1873763967727616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786960689.485089:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960689.485101:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960689.485104:0:8436:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786960689.485111:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1786960689.485134:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8436:1873763967727744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960689.485181:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.485284:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4240 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.486388:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727744 00000100:00100000:0.0:1786960689.486400:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727744 00000100:00100000:3.0:1786960689.486546:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1786960689.486557:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8436:x1873763967727744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.486838:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:8436:x1873763967727744:12345-0@lo:502:llog_process_th.0 Request processed in 282us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960689.486845:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786960689.486942:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8436:1873763967727744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786960689.486986:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960689.486993:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960689.487000:0:8436:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786960689.487005:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1786960689.487406:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1786960689.487430:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1786960689.487443:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.487455:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960689.487467:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786960689.487470:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff976652341800 from 39 10000000:01000000:3.0:1786960689.487474:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786960689.487509:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.487517:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.487528:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960689.487552:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.487594:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.487628:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565300 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.487732:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967727872 00000100:00100000:1.0:1786960689.487739:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967727872 00000100:00100000:1.0:1786960689.487778:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786960689.487788:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967727872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960689.487800:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960689.487827:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6c00/0x1808d16e4c97f530 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f529 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.487855:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6c00/0x1808d16e4c97f530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f529 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.487866:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6c00/0x1808d16e4c97f530 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f529 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.487876:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6c00, rc 0) 00000100:00100000:1.0:1786960689.487909:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967727872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.487915:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1786960689.487987:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967727872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960689.488004:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.488024:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960689.488088:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.488113:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.488134:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565300 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.488379:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728000 00000100:00100000:1.0:1786960689.488383:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728000 00000100:00100000:1.0:1786960689.488406:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1786960689.488412:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967728000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.488667:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967728000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.488675:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1786960689.488752:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.488781:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.488829:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.488856:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565300 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.488894:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728128 00000100:00100000:1.0:1786960689.488898:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728128 00000100:00100000:1.0:1786960689.488931:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1786960689.488937:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967728128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.489092:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967728128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.489100:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1786960689.489369:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.489855:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8437:1873763967728256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.489897:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.489926:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.489974:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728256 00000100:00100000:1.0:1786960689.489979:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728256 00000100:00100000:1.0:1786960689.490010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1786960689.490018:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8437:x1873763967728256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960689.490606:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8437:x1873763967728256:12345-0@lo:502:llog_process_th.0 Request processed in 586us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.490614:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1786960689.490744:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8437:1873763967728256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.490790:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8437:1873763967728384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.490834:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.490863:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.491759:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728384 00000100:00100000:1.0:1786960689.491770:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728384 00000100:00100000:1.0:1786960689.491814:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786960689.491835:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8437:x1873763967728384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960689.492157:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8437:x1873763967728384:12345-0@lo:502:llog_process_th.0 Request processed in 316us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.492166:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786960689.493232:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8437:1873763967728384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1786960689.493289:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786960689.493861:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1786960689.493884:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786960689.493898:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.493911:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960689.493945:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786960689.493949:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1786960689.493952:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786960689.494007:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.494016:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.494028:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960689.494347:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.494425:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960689.494468:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ad0b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.494528:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728512 00000100:00100000:0.0:1786960689.494536:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728512 00000100:00100000:0.0:1786960689.494594:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1786960689.494605:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967728512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960689.494624:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960689.494641:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f53e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f537 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.494670:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f537 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.494682:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f537 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.494701:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1c00, rc 0) 00000100:00100000:0.0:1786960689.494753:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967728512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.494761:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1786960689.497460:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960689.497496:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960689.497531:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960689.497631:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.497703:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.497756:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.497833:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728640 00000100:00100000:0.0:1786960689.497840:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728640 00000100:00100000:0.0:1786960689.497894:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1786960689.497904:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967728640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960689.498467:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967728640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 562us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.498476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786960689.498785:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.498845:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.498893:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.498915:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565600 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.498967:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728768 00000100:00100000:0.0:1786960689.498972:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728768 00000100:00100000:0.0:1786960689.499004:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1786960689.499012:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967728768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960689.500138:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967728768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1117us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.500158:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1786960689.500460:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967728768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.500940:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8438:1873763967728896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.501004:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.501052:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960689.501180:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967728896 00000100:00100000:0.0:1786960689.501386:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967728896 00000100:00100000:0.0:1786960689.501433:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1786960689.501442:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8438:x1873763967728896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960689.501713:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8438:x1873763967728896:12345-0@lo:502:llog_process_th.0 Request processed in 271us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960689.501721:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1786960689.502079:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8438:1873763967728896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960689.502115:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960689.502126:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960689.502129:0:8438:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786960689.502136:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786960689.502178:0:8438:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8438:1873763967729024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960689.502494:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960689.502532:0:8438:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766451956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.502577:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729024 00000100:00100000:1.0:1786960689.502582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729024 00000100:00100000:1.0:1786960689.502614:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1786960689.502622:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8438:x1873763967729024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960689.502833:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8438:x1873763967729024:12345-0@lo:502:llog_process_th.0 Request processed in 211us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.502839:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1786960689.505128:0:8438:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8438:1873763967729024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960689.505590:0:8438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960689.505601:0:8438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960689.505605:0:8438:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786960689.505610:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1786960689.505804:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1786960689.505837:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786960689.505852:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.505872:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960689.505885:0:5807:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786960689.505888:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97664e5c8000 from 1 10000000:01000000:0.0:1786960689.505891:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786960689.505936:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.505945:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.505967:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960689.505996:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967729152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786960689.506081:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960689.506136:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960689.506834:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729152 00000100:00100000:1.0:1786960689.506846:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729152 00000100:00100000:1.0:1786960689.506920:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1786960689.506931:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967729152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960689.506949:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960689.506977:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a7600/0x1808d16e4c97f54c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f545 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.507006:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a7600/0x1808d16e4c97f54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f545 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.507018:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a7600/0x1808d16e4c97f54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f545 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960689.507029:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7600, rc 0) 00000100:00100000:1.0:1786960689.507091:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967729152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960689.507098:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1786960689.507505:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967729152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960689.507529:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.507538:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960689.507603:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967729280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960689.507635:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960689.507679:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960689.509382:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729280 00000100:00100000:3.0:1786960689.509399:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729280 00000100:00100000:3.0:1786960689.509466:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1786960689.509477:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967729280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960689.509848:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967729280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (2209us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960689.509857:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1786960689.510308:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967729280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1786960689.510365:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786960689.510376:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960689.510388:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960690.422356:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960690.582264:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960690.582760:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264448 00000100:00100000:3.0:1786960690.582773:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264448 00000100:00100000:3.0:1786960690.582906:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1786960690.582920:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:5583:x1873763958264448:12345-192.168.203.23@tcp:101: 00010000:00010000:3.0:1786960690.582942:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960690.582967:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682168400/0x1808d16e4c97f553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bdfb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960690.583006:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168400/0x1808d16e4c97f553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdfb expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960690.583020:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682168400/0x1808d16e4c97f553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdfb expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960690.583032:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168400, rc 0) 00000100:00100000:3.0:1786960690.583112:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958264448:12345-192.168.203.23@tcp:101: Request processed in 195us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960690.583141:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:1.0:1786960690.587662:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960690.587799:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264576 00000100:00100000:3.0:1786960690.587820:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264576 00000100:00100000:3.0:1786960690.587884:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:3.0:1786960690.587895:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958264576:12345-192.168.203.23@tcp:501: 00000100:00100000:3.0:1786960690.588320:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958264576:12345-192.168.203.23@tcp:501: Request processed in 423us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960690.588328:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:2.0:1786960690.595380:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960690.595620:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264704 00000100:00100000:3.0:1786960690.595633:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264704 00000100:00100000:3.0:1786960690.595713:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:3.0:1786960690.595726:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958264704:12345-192.168.203.23@tcp:503: 00000100:00100000:3.0:1786960690.597383:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958264704:12345-192.168.203.23@tcp:503: Request processed in 316us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960690.597501:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1786960690.602179:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960690.602695:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264832 00000100:00100000:0.0:1786960690.602710:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264832 00000100:00100000:0.0:1786960690.602783:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:0.0:1786960690.602794:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:6062:x1873763958264832:12345-192.168.203.23@tcp:502: 00000100:00100000:0.0:1786960690.603227:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:6062:x1873763958264832:12345-192.168.203.23@tcp:502: Request processed in 395us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960690.603236:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:2.0:1786960690.606741:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960690.606899:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958264960 00000100:00100000:3.0:1786960690.606914:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958264960 00000100:00100000:3.0:1786960690.606981:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:3.0:1786960690.606993:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:6062:x1873763958264960:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786960690.607415:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:6062:x1873763958264960:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 411us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960690.607431:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:2.0:1786960690.614131:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960690.619748:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265088 00000100:00100000:1.0:1786960690.619769:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265088 00000100:00100000:1.0:1786960690.619872:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:1.0:1786960690.619884:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958265088:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960690.619908:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960690.619932:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6a00/0x1808d16e4c97f55a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960690.619970:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6a00/0x1808d16e4c97f55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be02 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960690.620003:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6a00/0x1808d16e4c97f55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be02 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960690.620014:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6a00, rc 0) 00000100:00100000:1.0:1786960690.620103:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958265088:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 221us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960690.620110:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:1.0:1786960690.624408:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960690.624564:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265216 00000100:00100000:0.0:1786960690.624588:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265216 00000100:00100000:0.0:1786960690.624662:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:0.0:1786960690.624675:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958265216:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960690.625050:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958265216:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 376us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786960690.625060:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00010000:00010000:0.0:1786960691.446730:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786960692.202646:0:8477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc993a4f20 20000000:00000080:3.0:1786960692.202665:0:8477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff976677199c00 uarg=0000000000000000 20000000:01000000:3.0:1786960692.202705:0:8477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960692.202717:0:8477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960692.202722:0:8477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1786960692.204983:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1786960692.205363:0:8477:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1786960692.210410:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1786960692.210904:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1786960692.210961:0:8477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1786960692.210980:0:8477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786960692.210999:0:8477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211017:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211091:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211098:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211106:0:8477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211113:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211152:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211169:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 9 pid: 5805 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.211214:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729408:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960692.211330:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.211339:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 18 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.211349:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729536:0@lo:104: 00000100:00100000:3.0:1786960692.211387:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960692.213023:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.213050:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 18 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.213061:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729664:0@lo:104: 00000100:00100000:3.0:1786960692.213100:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960692.214317:0:8477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.214329:0:8477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 18 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.214339:0:8477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729792:0@lo:104: 00000100:00100000:3.0:1786960692.214365:0:8477:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786960692.214613:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960692.214685:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729408:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960692.214724:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265344 00000100:00100000:0.0:1786960692.214730:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265344 00010000:00010000:0.0:1786960692.214767:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960692.214812:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1786960692.214821:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958265344:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960692.214833:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960692.214838:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.214849:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.214864:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168c00/0x1808d16e4c97f4c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdca expref: 10 pid: 5805 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.214885:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960692.214929:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:2344:x1873763958265344:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960692.214937:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1786960692.215380:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786960692.215412:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960692.215432:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729536 00000100:00100000:3.0:1786960692.215437:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729536 00000100:00100000:3.0:1786960692.215468:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729664 00000100:00100000:3.0:1786960692.215471:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729664 00000100:00100000:3.0:1786960692.215480:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729792 00000100:00100000:3.0:1786960692.215482:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729792 00000100:00100000:3.0:1786960692.215492:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786960692.215497:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:8477:x1873763967729536:12345-0@lo:104: 00010000:00010000:3.0:1786960692.215509:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215553:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786960692.215558:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:8477:x1873763967729536:12345-0@lo:104: Request processed in 61us (4172us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.215564:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786960692.215578:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786960692.215584:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8477:x1873763967729664:12345-0@lo:104: 00010000:00010000:3.0:1786960692.215590:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215623:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786960692.215627:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae7e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:8477:x1873763967729664:12345-0@lo:104: Request processed in 44us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.215633:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786960692.215662:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786960692.215668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8477:x1873763967729792:12345-0@lo:104: 00010000:00010000:3.0:1786960692.215675:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215700:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786960692.215710:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:8477:x1873763967729792:12345-0@lo:104: Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.215716:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1786960692.215732:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786960692.215738:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215745:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960692.215749:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215757:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960692.215764:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960692.215770:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786960692.215795:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215813:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960692.215831:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215838:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169a600/0x1808d16e4c97f3fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f403 expref: -99 pid: 7599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215853:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786960692.215857:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215873:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045e00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960692.215876:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215883:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960692.215890:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960692.215896:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786960692.215910:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215916:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960692.215930:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215937:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682045e00/0x1808d16e4c97f331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f338 expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215950:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960692.215953:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215959:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960692.215962:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.215978:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960692.215984:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960692.215988:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786960692.216002:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216007:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960692.216013:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216019:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682169200/0x1808d16e4c97f2cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f2d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216050:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960692.216052:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960692.216053:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960692.216060:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960692.216070:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967729920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960692.216102:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960692.216130:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967730048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960692.216148:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960692.216161:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786960692.216166:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967730176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960692.216181:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960692.216229:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967729920 00000100:00100000:3.0:1786960692.216232:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967729920 00010000:00010000:3.0:1786960692.216248:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 19 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.216259:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730048 00000100:00100000:3.0:1786960692.216261:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730048 00010000:00010000:3.0:1786960692.216268:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 20 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.216277:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730176 00000100:00100000:3.0:1786960692.216278:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730176 00010000:00010000:3.0:1786960692.216285:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 21 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960692.216295:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786960692.216301:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+21:3287:x1873763967729920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960692.216308:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960692.216312:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 21 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216321:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 21 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216332:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960692.216354:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+21:3287:x1873763967729920:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.216361:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786960692.216372:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960692.216377:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3285:x1873763967730048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960692.216392:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960692.216395:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 20 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216403:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 20 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216412:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960692.216432:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3285:x1873763967730048:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.216437:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960692.216447:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960692.216452:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967730176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960692.216458:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960692.216462:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 19 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216470:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 19 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216480:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216487:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216499:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216505:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216517:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216524:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216528:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960692.216532:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216540:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216547:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960692.216555:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960692.216574:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967730176:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.216579:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960692.216604:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967729920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960692.216626:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967730176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960692.216633:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967730048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786960692.217175:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169000/0x1808d16e4c97f403 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f3fc expref: 18 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960692.217208:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729536:0@lo:104: 00010000:00010000:0.0:1786960692.217220:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169b400/0x1808d16e4c97f338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f331 expref: 17 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960692.217231:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729664:0@lo:104: 00010000:00010000:0.0:1786960692.217241:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f2d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f2cf expref: 16 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960692.217261:0:8477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8477:1873763967729792:0@lo:104: 00010000:00010000:0.0:1786960692.217280:0:8477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.217290:0:8477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.217296:0:8477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960692.217302:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168000/0x1808d16e4c97f561 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960692.218341:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960692.218532:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1786960692.468566:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960692.889350:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960692.890122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960692.890159:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960692.890217:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960692.890252:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265472 00000100:00100000:0.0:1786960692.890252:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265856 00000100:00100000:3.0:1786960692.890265:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265472 00000100:00100000:0.0:1786960692.890270:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265856 00000100:00100000:0.0:1786960692.890330:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265728 00000100:00100000:3.0:1786960692.890331:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:0.0:1786960692.890336:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265728 00000100:00100000:3.0:1786960692.890346:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:2343:x1873763958265472:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960692.890364:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960692.890374:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958265856:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960692.890439:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958265856:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.890440:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:2343:x1873763958265472:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960692.890459:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:0.0:1786960692.890460:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960692.890481:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1786960692.890490:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958265728:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960692.890524:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958265728:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 36us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960692.890541:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00080000:0.0:1786960692.890560:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960692.890564:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960692.890923:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265600 00000100:00100000:1.0:1786960692.890929:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265600 00000100:00100000:1.0:1786960692.891053:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:1.0:1786960692.891062:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958265600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960692.891103:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958265600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (1767us total) trans 0 rc 0/0 00000100:00080000:0.0:1786960692.891109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960692.891112:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1786960693.044862:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967730304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960693.044967:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960693.045317:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960693.045345:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967730688:0@lo:400:kworker.0 00000100:00100000:0.0:1786960693.045413:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.045505:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967730432:0@lo:400:kworker.0 00000100:00100000:1.0:1786960693.045546:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.045590:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730432 00000100:00100000:1.0:1786960693.045599:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730432 00000100:00100000:1.0:1786960693.045654:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1786960693.045664:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3288:x1873763967730432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960693.045727:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3288:x1873763967730432:12345-0@lo:400:kworker.0 Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.045746:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1786960693.046769:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967730560:0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.046781:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967730816:0@lo:400:kworker.0 00000100:00100000:1.0:1786960693.046844:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960693.046890:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730304 00000100:00100000:3.0:1786960693.046900:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730304 00000100:00100000:1.0:1786960693.046971:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967730432:0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.046982:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960693.046987:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967730944:0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.047004:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967730304:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960693.047035:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1786960693.047045:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960693.047105:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730944 00000100:00100000:1.0:1786960693.047112:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730944 00000100:00100000:3.0:1786960693.047122:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967730304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960693.047132:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960693.047174:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960693.047224:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730688 00000100:00100000:1.0:1786960693.047231:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967730944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.047235:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730688 00000100:00100000:3.0:1786960693.047287:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730560 00000100:00100000:3.0:1786960693.047292:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730560 00000100:00100000:3.0:1786960693.047315:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786960693.047325:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967730688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.047387:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967730688:12345-0@lo:400:kworker.0 Request processed in 63us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960693.047408:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786960693.047431:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786960693.047446:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967730560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960693.047511:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967730560:12345-0@lo:400:kworker.0 Request processed in 68us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.047520:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1786960693.047571:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960693.047578:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786960693.047580:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960693.047872:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967730944:12345-0@lo:400:kworker.0 Request processed in 683us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.047881:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960693.047946:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967730688:0@lo:400:kworker.0 00010000:00080000:0.0:1786960693.047958:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ace4380 x1873763967730944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960693.047964:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967730560:0@lo:400:kworker.0 00000100:00100000:0.0:1786960693.047980:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967730944:0@lo:400:kworker.0 00000100:00100000:1.0:1786960693.048003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786960693.048056:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45180 x1873763967730304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960693.048076:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967730304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960693.048140:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967730816 00000100:00100000:2.0:1786960693.048146:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967730816 00000100:00080000:1.0:1786960693.048387:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960693.048475:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786960693.048485:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967730816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960693.048634:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967730816:12345-0@lo:400:kworker.0 Request processed in 151us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960693.048642:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786960693.049115:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967730816:0@lo:400:kworker.0 00000100:00100000:3.0:1786960693.414678:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960693.415241:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958265984 00000100:00100000:2.0:1786960693.415253:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958265984 00000100:00100000:2.0:1786960693.415309:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:2.0:1786960693.415319:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+9:5583:x1873763958265984:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960693.415336:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960693.415355:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.415394:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.415405:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.415415:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:2.0:1786960693.415469:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958265984:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 152us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960693.415477:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1786960693.421977:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960693.422160:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266112 00000100:00100000:0.0:1786960693.422171:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266112 00000100:00100000:0.0:1786960693.422255:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:0.0:1786960693.422265:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958266112:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.422667:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958266112:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 402us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.422675:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:3.0:1786960693.436879:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960693.436993:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266240 00000100:00100000:1.0:1786960693.437003:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266240 00000100:00100000:1.0:1786960693.437092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:1.0:1786960693.437102:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958266240:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.437653:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:5583:x1873763958266240:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 551us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.437663:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:2.0:1786960693.458994:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960693.461405:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266368 00000100:00100000:3.0:1786960693.461418:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266368 00000100:00100000:3.0:1786960693.461599:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:3.0:1786960693.461609:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:6122:x1873763958266368:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786960693.461857:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:6122:x1873763958266368:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 248us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960693.461865:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:0.0:1786960693.474837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960693.474896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266496 00000100:00100000:1.0:1786960693.474906:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266496 00000100:00100000:1.0:1786960693.474956:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:1.0:1786960693.474966:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:6122:x1873763958266496:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960693.475247:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:6122:x1873763958266496:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 281us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.475255:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 176 00010000:00010000:1.0:1786960693.496883:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960693.557056:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967731072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960693.557122:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.557200:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731072 00000100:00100000:1.0:1786960693.557206:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731072 00000100:00100000:1.0:1786960693.557260:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960693.557269:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967731072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960693.557300:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960693.557501:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967731072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.557510:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1786960693.557550:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ace6680 x1873763967731072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960693.557587:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967731072:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1786960693.748511:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786960693.748519:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e6000 from 4 10000000:01000000:0.0:1786960693.748524:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786960693.748571:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.748582:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.748593:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960693.748619:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.748758:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960693.748883:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786960693.753949:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731200 00000100:00100000:3.0:1786960693.753963:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731200 00000100:00100000:3.0:1786960693.754139:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1786960693.754150:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967731200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960693.754168:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960693.754203:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f56f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960693.754232:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960693.754243:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960693.754251:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a600, rc 0) 00000100:00100000:3.0:1786960693.754322:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (5564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960693.754353:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786960693.754459:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960693.754477:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.754486:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960693.754552:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.754583:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960693.764073:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.770854:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731328 00000100:00100000:1.0:1786960693.770870:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731328 00000100:00100000:0.0:1786960693.781930:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786960693.781944:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.782276:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (27690us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.782290:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786960693.782575:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.782627:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.782678:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960693.782713:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960693.782732:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731456 00000100:00100000:0.0:1786960693.782737:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731456 00000100:00100000:0.0:1786960693.782757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1786960693.782764:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.782920:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.782926:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1786960693.782956:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.785646:0:8546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8546:1873763967731584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960693.785727:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960693.785769:0:8546:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.786855:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731584 00000100:00100000:1.0:1786960693.786865:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731584 00000100:00100000:1.0:1786960693.786930:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1786960693.786940:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8546:x1873763967731584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.787182:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8546:x1873763967731584:12345-0@lo:502:llog_process_th.0 Request processed in 242us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.787212:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1786960693.787389:0:8546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8546:1873763967731584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960693.787437:0:8546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960693.787447:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960693.787449:0:8546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786960693.787457:0:8546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766772e6000 00000020:00000080:2.0:1786960693.787460:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786960693.787540:0:8546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8546:1873763967731712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960693.787580:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960693.787603:0:8546:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a180 going to sleep for 11 seconds 00000100:00100000:0.0:1786960693.789247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731712 00000100:00100000:0.0:1786960693.789258:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731712 00000100:00100000:0.0:1786960693.789301:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1786960693.789309:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8546:x1873763967731712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960693.789704:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:8546:x1873763967731712:12345-0@lo:502:llog_process_th.0 Request processed in 395us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.789711:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1786960693.790267:0:8546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8546:1873763967731712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960693.790301:0:8546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960693.790309:0:8546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960693.790311:0:8546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786960693.790316:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786960693.795273:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1786960693.795312:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960693.795323:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.795358:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960693.795368:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786960693.795371:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97667ad21800 from 4 10000000:01000000:0.0:1786960693.795374:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786960693.795592:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.795600:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.795610:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960693.795635:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786960693.795697:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960693.795735:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195240 going to sleep for 11 seconds 00000100:00100000:2.0:1786960693.796550:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731840 00000100:00100000:2.0:1786960693.796559:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731840 00000100:00100000:2.0:1786960693.796605:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1786960693.796614:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967731840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960693.796628:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960693.796641:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f57d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.796666:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.796677:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.796696:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:2.0:1786960693.796746:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967731840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960693.796752:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1786960693.796798:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960693.796813:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960693.796822:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960693.796872:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.796899:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960693.796914:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786960693.796925:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967731968 00000100:00100000:2.0:1786960693.796929:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967731968 00000100:00100000:2.0:1786960693.796946:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786960693.796952:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967731968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.797208:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967731968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960693.797215:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1786960693.797243:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967731968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.797269:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.797305:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960693.797326:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a180 going to sleep for 11 seconds 00000100:00100000:2.0:1786960693.797349:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732096 00000100:00100000:2.0:1786960693.797353:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732096 00000100:00100000:2.0:1786960693.797371:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786960693.797377:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967732096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960693.797510:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967732096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960693.797517:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786960693.797553:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.820729:0:8548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8548:1873763967732224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.820819:0:8548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.820856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732224 00000100:00100000:1.0:1786960693.820863:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732224 00000100:00100000:1.0:1786960693.820914:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786960693.820923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8548:x1873763967732224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.821110:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8548:x1873763967732224:12345-0@lo:502:llog_process_th.0 Request processed in 188us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.821118:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1786960693.821166:0:8548:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.821204:0:8548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8548:1873763967732224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786960693.821231:0:8548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960693.821240:0:8548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960693.821242:0:8548:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786960693.821248:0:8548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97667ad21800 00000020:00000080:1.0:1786960693.821256:0:8548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786960693.821320:0:8548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8548:1873763967732352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.821365:0:8548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.821376:0:8548:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.821388:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732352 00000100:00100000:1.0:1786960693.821391:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732352 00000100:00100000:1.0:1786960693.821411:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1786960693.821417:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8548:x1873763967732352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.821516:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:8548:x1873763967732352:12345-0@lo:502:llog_process_th.0 Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.821523:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1786960693.821557:0:8548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8548:1873763967732352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786960693.821573:0:8548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960693.821577:0:8548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960693.821578:0:8548:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786960693.821582:0:8548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1786960693.821625:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1786960693.821639:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960693.821649:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821659:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960693.821670:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786960693.821672:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff976652341800 from 4 10000000:01000000:1.0:1786960693.821674:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960693.821696:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821714:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821724:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960693.821737:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.821761:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.821774:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.821784:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732480 00000100:00100000:1.0:1786960693.821798:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732480 00000100:00100000:1.0:1786960693.821819:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786960693.821825:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967732480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960693.821833:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960693.821844:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f58b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821862:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821871:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821879:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7000, rc 0) 00000100:00100000:1.0:1786960693.821903:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967732480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.821909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786960693.821942:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960693.821953:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960693.821960:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960693.821995:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.822017:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.822030:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.822039:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732608 00000100:00100000:1.0:1786960693.822042:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732608 00000100:00100000:1.0:1786960693.822057:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1786960693.822062:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967732608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.822291:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967732608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.822298:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1786960693.822325:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.822347:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.822380:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.822392:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960693.822401:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732736 00000100:00100000:1.0:1786960693.822404:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732736 00000100:00100000:1.0:1786960693.822419:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1786960693.822424:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967732736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.822530:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967732736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960693.822542:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1786960693.822572:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967732736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960693.841338:0:8549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8549:1873763967732864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960693.841426:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960693.841480:0:8549:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667719f600 going to sleep for 11 seconds 00000100:00100000:0.0:1786960693.841729:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732864 00000100:00100000:0.0:1786960693.841737:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732864 00000100:00100000:0.0:1786960693.841782:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1786960693.841801:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:8549:x1873763967732864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960693.842018:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:8549:x1873763967732864:12345-0@lo:502:llog_process_th.0 Request processed in 228us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.842031:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1786960693.842081:0:8549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8549:1873763967732864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960693.842114:0:8549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960693.842124:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960693.842127:0:8549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786960693.842134:0:8549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff976652341800 00000020:00000080:2.0:1786960693.842138:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786960693.842233:0:8549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8549:1873763967732992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960693.842284:0:8549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960693.842306:0:8549:0:(client.c:2702:ptlrpc_set_wait()) set ffff976664d8a780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960693.842680:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967732992 00000100:00100000:0.0:1786960693.842686:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967732992 00000100:00100000:0.0:1786960693.842725:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1786960693.842739:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:8549:x1873763967732992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960693.842886:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:8549:x1873763967732992:12345-0@lo:502:llog_process_th.0 Request processed in 148us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960693.842893:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1786960693.843178:0:8549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:8549:1873763967732992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960693.843223:0:8549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960693.843230:0:8549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960693.843232:0:8549:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786960693.843236:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786960693.843720:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1786960693.843741:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960693.843751:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960693.843762:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960694.516353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960695.541434:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960696.569397:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960697.589454:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960698.025667:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960698.025704:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960698.025807:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266752 00000100:00100000:1.0:1786960698.025816:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266752 00000100:00100000:1.0:1786960698.025896:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1786960698.025907:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958266752:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1786960698.025976:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960698.025983:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958266752:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.025991:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1786960698.026374:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266624 00000100:00100000:2.0:1786960698.026380:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266624 00000100:00100000:2.0:1786960698.026419:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:2.0:1786960698.026426:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958266624:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960698.026471:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958266624:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 45us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960698.026478:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:3.0:1786960698.032397:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960698.032425:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960698.032461:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267008 00000100:00100000:3.0:1786960698.032470:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267008 00000100:00100000:3.0:1786960698.032519:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958266880 00000100:00100000:3.0:1786960698.032522:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958266880 00000100:00100000:3.0:1786960698.032543:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960698.032552:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958267008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960698.032614:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958267008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960698.032622:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960698.032637:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1786960698.032643:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958266880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960698.032665:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958266880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960698.032671:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00080000:3.0:1786960698.032786:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960698.032790:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960698.164362:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967733120:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164428:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164471:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967733632:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164496:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164522:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960698.164527:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967733504:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164551:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164578:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967733248:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164599:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164621:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967733760:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164642:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164670:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960698.164676:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967733376:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164697:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960698.164726:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733120 00000100:00100000:1.0:1786960698.164733:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733120 00000100:00100000:2.0:1786960698.164738:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733632 00000100:00100000:2.0:1786960698.164741:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733632 00000100:00100000:2.0:1786960698.164777:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733248 00000100:00100000:2.0:1786960698.164780:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733248 00000100:00100000:1.0:1786960698.164782:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1786960698.164789:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967733120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960698.164791:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733376 00000100:00100000:2.0:1786960698.164793:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733376 00000100:00100000:2.0:1786960698.164805:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786960698.164811:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164835:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967733120:12345-0@lo:400:kworker.0 Request processed in 46us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960698.164839:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967733632:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.164842:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1786960698.164844:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786960698.164856:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786960698.164861:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967733248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164869:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960698.164876:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1786960698.164888:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967733248:12345-0@lo:400:kworker.0 Request processed in 27us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.164890:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733504 00000100:00100000:1.0:1786960698.164893:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733504 00000100:00100000:2.0:1786960698.164894:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786960698.164904:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786960698.164909:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967733376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164917:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733760 00000100:00100000:1.0:1786960698.164919:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733760 00000100:00100000:2.0:1786960698.164934:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967733376:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.164939:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960698.164940:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786960698.164944:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967733504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.164972:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967733504:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.164978:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786960698.165807:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786960698.165817:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.165857:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967733760:12345-0@lo:400:kworker.0 Request processed in 43us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960698.165863:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1786960698.166144:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960698.166155:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960698.166158:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960698.166241:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967733376:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.166267:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967733248:0@lo:400:kworker.0 00010000:00080000:1.0:1786960698.166278:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ace4380 x1873763967733760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960698.166289:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967733760:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.166311:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960698.166319:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967733888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960698.166347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786960698.166444:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ace6d80 x1873763967733504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960698.166454:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967733504:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.166464:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967733120:0@lo:400:kworker.0 00000100:00100000:1.0:1786960698.166474:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967733632:0@lo:400:kworker.0 00000100:00100000:3.0:1786960698.166841:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967733888 00000100:00100000:3.0:1786960698.166847:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967733888 00000100:00100000:3.0:1786960698.166888:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960698.166896:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967733888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960698.166925:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960698.167075:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967733888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960698.167083:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1786960698.168442:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976647b45180 x1873763967733888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960698.168462:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967733888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786960698.615314:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786960698.641039:0:8776:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1786960698.686679:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967734016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960698.686749:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960698.687141:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734016 00000100:00100000:2.0:1786960698.687150:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734016 00000100:00100000:2.0:1786960698.687227:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786960698.687237:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967734016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960698.687272:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960698.687321:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967734016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960698.687328:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1786960698.687368:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97664e74dc00 x1873763967734016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960698.687387:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967734016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960699.637069:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960700.660560:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960701.688197:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960702.717317:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960703.131899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960703.131945:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960703.132050:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267136 00000100:00100000:1.0:1786960703.132059:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267136 00000100:00100000:1.0:1786960703.132105:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:1.0:1786960703.132114:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958267136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960703.132207:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958267136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 94us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960703.132215:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:3.0:1786960703.132652:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267264 00000100:00100000:3.0:1786960703.132657:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267264 00000100:00100000:3.0:1786960703.132703:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1786960703.132710:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958267264:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960703.132759:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958267264:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 49us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960703.132766:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00080000:1.0:1786960703.132983:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960703.137547:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960703.137678:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267392 00000100:00100000:3.0:1786960703.137691:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267392 00000100:00100000:3.0:1786960703.137783:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1786960703.137794:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2340:x1873763958267392:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:3.0:1786960703.137830:0:6660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f4ce 00000100:00080000:3.0:1786960703.137841:0:6660:0:(import.c:65:import_set_state_nolock()) ffff97667ac8b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960703.137881:0:6660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786960703.138253:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+2:2340:x1873763958267392:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 460us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960703.138262:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00010000:00010000:3.0:1786960703.138312:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786960703.138567:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960703.147881:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960703.147992:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267520 00000100:00100000:3.0:1786960703.148002:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267520 00000100:00100000:3.0:1786960703.148065:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1786960703.148074:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2340:x1873763958267520:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:3.0:1786960703.148110:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f4d5 00000100:00080000:3.0:1786960703.148120:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667ac8a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960703.148161:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1786960703.148263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960703.148849:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+2:2340:x1873763958267520:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 773us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960703.148858:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00010000:00010000:3.0:1786960703.148887:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960703.284543:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967734528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960703.284614:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960703.284673:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960703.284680:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967734144:0@lo:400:kworker.0 00000100:00100000:2.0:1786960703.284712:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960703.284762:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734528 00000100:00100000:2.0:1786960703.284769:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734528 00000100:00100000:2.0:1786960703.284823:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960703.284832:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967734528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960703.284865:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960703.284909:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967734528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960703.284916:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960703.284939:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734144 00000100:00100000:2.0:1786960703.284943:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734144 00000100:00100000:2.0:1786960703.284966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1786960703.284981:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967734144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960703.285016:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967734144:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960703.285022:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1786960703.285048:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960703.285079:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967734144:0@lo:400:kworker.0 00010000:00080000:2.0:1786960703.285094:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b9880 x1873763967734528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960703.285110:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967734528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960703.285233:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967734656:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285265:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960703.285297:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967734272:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960703.285345:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967734784:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285368:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960703.285387:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960703.285392:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967734400:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285579:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960703.285619:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734656 00000100:00100000:1.0:1786960703.285623:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734656 00000100:00100000:1.0:1786960703.285655:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734272 00000100:00100000:1.0:1786960703.285659:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734272 00000100:00100000:1.0:1786960703.285671:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734400 00000100:00100000:1.0:1786960703.285673:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734400 00000100:00100000:1.0:1786960703.285688:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786960703.285695:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967734656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285747:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967734656:12345-0@lo:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960703.285753:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786960703.285766:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786960703.285771:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285812:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967734272:12345-0@lo:400:kworker.0 Request processed in 40us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960703.285818:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786960703.285829:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786960703.285836:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967734400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285862:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967734400:12345-0@lo:400:kworker.0 Request processed in 27us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960703.285867:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786960703.285898:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967734656:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285918:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967734400:0@lo:400:kworker.0 00000100:00100000:1.0:1786960703.285925:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967734272:0@lo:400:kworker.0 00000100:00080000:2.0:1786960703.286609:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960703.286770:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734784 00000100:00100000:3.0:1786960703.286777:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734784 00000100:00100000:3.0:1786960703.287557:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786960703.287567:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960703.287640:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967734784:12345-0@lo:400:kworker.0 Request processed in 75us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960703.287647:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1786960703.287687:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97664e74d180 x1873763967734784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960703.287701:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967734784:0@lo:400:kworker.0 00000100:00080000:2.0:1786960703.291035:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786960703.739323:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786960703.794108:0:9020:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing yml_node 00000100:00100000:2.0:1786960703.796389:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967734912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960703.796460:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960703.796539:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967734912 00000100:00100000:2.0:1786960703.796546:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967734912 00000100:00100000:2.0:1786960703.796594:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786960703.796604:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967734912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960703.796639:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960703.796683:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967734912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960703.796690:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1786960703.796746:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97666b4b9880 x1873763967734912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960703.796766:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967734912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960704.756415:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960705.783582:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960706.804575:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960707.406239:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:1.0:1786960707.406249:0:7615:0:(genops.c:906:class_export_put()) final put ffff97667ac8d800/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:3.0:1786960707.406333:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ac8d800/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-OST0001 00000020:00000080:3.0:1786960707.406392:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ac8a000 for lustre-OST0001 00010000:00010000:1.0:1786960707.828467:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786960707.965395:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:0.0:1786960707.965408:0:6685:0:(genops.c:906:class_export_put()) final put ffff97667ac8f800/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:1.0:1786960707.965495:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ac8f800/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-OST0000 00000020:00000080:1.0:1786960707.965567:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ac8b800 for lustre-OST0000 00000100:00100000:3.0:1786960708.248028:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960708.248083:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960708.248342:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267776 00000100:00100000:1.0:1786960708.248355:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267776 00000100:00100000:1.0:1786960708.248446:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1786960708.248458:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958267776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960708.248547:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958267776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960708.248577:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1786960708.248933:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267648 00000100:00100000:2.0:1786960708.248945:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267648 00000100:00080000:3.0:1786960708.249070:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960708.249107:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:2.0:1786960708.249116:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2343:x1873763958267648:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960708.249165:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2343:x1873763958267648:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 51us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960708.249172:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:2.0:1786960708.404593:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967735296:0@lo:400:kworker.0 00000100:00100000:2.0:1786960708.404710:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960708.404806:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960708.404814:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967735424:0@lo:400:kworker.0 00000100:00100000:2.0:1786960708.404847:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960708.405018:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735424 00000100:00100000:3.0:1786960708.405027:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735424 00000100:00100000:3.0:1786960708.405099:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786960708.405110:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967735424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960708.405169:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967735424:12345-0@lo:400:kworker.0 Request processed in 62us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960708.405177:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1786960708.405233:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960708.405406:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967735040:0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405446:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960708.405481:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967735552:0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405506:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960708.405528:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1786960708.405534:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967735168:0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405574:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960708.405595:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967735680:0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405616:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960708.405646:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735296 00000100:00100000:0.0:1786960708.405650:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735296 00000100:00100000:0.0:1786960708.405686:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735552 00000100:00100000:0.0:1786960708.405701:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735552 00000100:00100000:0.0:1786960708.405716:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735168 00000100:00100000:0.0:1786960708.405719:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735168 00000100:00100000:0.0:1786960708.405733:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786960708.405740:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967735296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405788:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967735296:12345-0@lo:400:kworker.0 Request processed in 48us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960708.405794:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786960708.405807:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786960708.405813:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967735552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405845:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967735552:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960708.405851:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786960708.405861:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786960708.405867:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967735168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.405892:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967735168:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960708.405898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786960708.405920:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735680 00000100:00100000:0.0:1786960708.405924:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735680 00000100:00100000:0.0:1786960708.405949:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786960708.405964:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967735680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.406009:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967735680:12345-0@lo:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960708.406016:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1786960708.406040:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786960708.406044:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960708.406078:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967735168:0@lo:400:kworker.0 00010000:00080000:0.0:1786960708.406093:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e7b80 x1873763967735680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960708.406105:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967735680:0@lo:400:kworker.0 00000100:00100000:0.0:1786960708.406116:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967735552:0@lo:400:kworker.0 00000100:00100000:3.0:1786960708.406302:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735040 00000100:00100000:3.0:1786960708.406307:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735040 00000100:00100000:3.0:1786960708.406345:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786960708.406351:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960708.406392:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967735040:12345-0@lo:400:kworker.0 Request processed in 41us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960708.406398:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1786960708.406434:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967735040:0@lo:400:kworker.0 00000100:00100000:2.0:1786960708.407332:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960708.407353:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967735808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960708.407406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1786960708.407517:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4700 x1873763967735424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960708.407529:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967735424:0@lo:400:kworker.0 00000100:00100000:2.0:1786960708.407542:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967735296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960708.410735:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735808 00000100:00100000:3.0:1786960708.410762:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735808 00000100:00100000:3.0:1786960708.411068:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786960708.411081:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967735808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960708.411151:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960708.411368:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967735808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 290us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960708.411377:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1786960708.412321:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69d180 x1873763967735808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960708.412350:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967735808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786960708.853238:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960708.916521:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960708.916552:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967735936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960708.916645:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960708.917877:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967735936 00000100:00100000:3.0:1786960708.917890:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967735936 00000100:00100000:3.0:1786960708.917965:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786960708.917976:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967735936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960708.918026:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960708.918115:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967735936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960708.918123:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1786960708.919514:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4700 x1873763967735936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960708.919546:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967735936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960709.876457:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786960710.208789:0:9214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.50 00010000:00010000:2.0:1786960710.911244:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960711.924487:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960712.950317:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960712.970814:0:9312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.50 00000100:00100000:0.0:1786960713.374369:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960713.374427:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960713.374552:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268032 00000100:00100000:1.0:1786960713.374563:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268032 00000100:00100000:1.0:1786960713.374633:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1786960713.374644:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958268032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960713.374736:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958268032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 94us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960713.374743:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960713.374794:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958267904 00000100:00100000:2.0:1786960713.374799:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958267904 00000100:00100000:2.0:1786960713.374835:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:2.0:1786960713.374843:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958267904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960713.374880:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958267904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960713.374885:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00080000:0.0:1786960713.375330:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960713.529299:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967736064:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.529389:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960713.529432:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967736576:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.529973:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960713.530004:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786960713.530012:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967736192:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.530052:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960713.530072:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967736704:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.530560:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960713.530653:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736064 00000100:00100000:0.0:1786960713.530672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736064 00000100:00100000:0.0:1786960713.530716:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1786960713.530725:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967736064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960713.530774:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967736064:12345-0@lo:400:kworker.0 Request processed in 51us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960713.530782:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1786960713.530821:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736576 00000100:00100000:0.0:1786960713.530824:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736576 00000100:00100000:0.0:1786960713.530854:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736192 00000100:00100000:0.0:1786960713.530856:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736192 00000100:00100000:0.0:1786960713.530872:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786960713.530878:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967736576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960713.530921:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967736576:12345-0@lo:400:kworker.0 Request processed in 43us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960713.530928:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786960713.530940:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786960713.530946:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967736192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960713.530972:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967736192:12345-0@lo:400:kworker.0 Request processed in 27us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960713.530978:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1786960713.530996:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960713.532989:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967736064:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.533012:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967736576:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.533063:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967736192:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.533099:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967736320:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.533145:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960713.533170:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967736832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960713.533211:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960713.533244:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960713.533251:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967736448:0@lo:400:kworker.0 00000100:00100000:1.0:1786960713.533271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960713.533341:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736832 00000100:00100000:3.0:1786960713.533347:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736832 00000100:00100000:3.0:1786960713.533400:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786960713.533408:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967736832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960713.533442:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960713.533482:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967736832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960713.533489:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1786960713.534200:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960713.534214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736320 00000100:00100000:0.0:1786960713.534220:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736320 00000100:00100000:0.0:1786960713.534272:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786960713.534280:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967736320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960713.534349:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967736320:12345-0@lo:400:kworker.0 Request processed in 70us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960713.534356:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1786960713.536344:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960713.547844:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736704 00000100:00100000:2.0:1786960713.547859:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736704 00000100:00100000:1.0:1786960713.547932:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967736320:0@lo:400:kworker.0 00010000:00080000:1.0:1786960713.547951:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e5f80 x1873763967736832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960713.547973:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967736832:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786960713.547980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960713.548049:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736448 00000100:00100000:2.0:1786960713.548054:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736448 00000100:00100000:3.0:1786960713.548061:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960713.548074:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967736704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960713.548089:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786960713.548099:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967736448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960713.548154:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967736704:12345-0@lo:400:kworker.0 Request processed in 84us (17594us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960713.548173:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786960713.550286:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967736448:12345-0@lo:400:kworker.0 Request processed in 2187us (17011us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960713.550298:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1786960713.550600:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97664e74c380 x1873763967736704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960713.550615:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967736704:0@lo:400:kworker.0 00010000:00080000:1.0:1786960713.550651:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97664e74d180 x1873763967736448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960713.550672:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967736448:0@lo:400:kworker.0 00010000:00010000:1.0:1786960713.979994:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960714.047957:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967736960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960714.048037:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960714.051227:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967736960 00000100:00100000:0.0:1786960714.051241:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967736960 00000100:00100000:0.0:1786960714.051291:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786960714.051435:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967736960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960714.051474:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960714.051574:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967736960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 275us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960714.051582:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1786960714.053560:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69ca80 x1873763967736960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960714.053586:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967736960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960714.996490:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960716.020426:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786960716.625073:0:9411:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.50 00010000:00010000:3.0:1786960717.047411:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960718.068617:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960718.489138:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960718.489224:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960718.490772:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268288 00000100:00100000:3.0:1786960718.490788:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268288 00000100:00100000:3.0:1786960718.490873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960718.490887:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958268288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960718.490992:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958268288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 108us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960718.491000:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00080000:3.0:1786960718.491038:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960718.492262:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268160 00000100:00100000:1.0:1786960718.492274:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268160 00000100:00100000:1.0:1786960718.492338:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:1.0:1786960718.492348:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958268160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960718.492432:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958268160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 86us (3309us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.492439:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:1.0:1786960718.654108:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967737088:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654233:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654299:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967737600:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654327:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654355:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786960718.654360:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967737216:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654388:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654406:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967737728:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654429:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654455:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967737344:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654477:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654490:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960718.654515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654538:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960718.654542:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737472:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654565:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960718.654596:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737600 00000100:00100000:1.0:1786960718.654614:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737600 00000100:00100000:1.0:1786960718.654680:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737216 00000100:00100000:1.0:1786960718.654683:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737216 00000100:00100000:1.0:1786960718.654695:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737344 00000100:00100000:1.0:1786960718.654697:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737344 00000100:00100000:1.0:1786960718.654713:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786960718.654722:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967737600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960718.654752:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737088 00000100:00100000:3.0:1786960718.654759:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737088 00000100:00100000:1.0:1786960718.654787:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967737600:12345-0@lo:400:kworker.0 Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.654796:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786960718.654801:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786960718.654812:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967737088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654823:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786960718.654831:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967737216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.654970:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967737216:12345-0@lo:400:kworker.0 Request processed in 139us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.654976:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1786960718.654987:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960718.654992:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967737344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655020:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967737344:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.655026:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960718.655043:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737856 00000100:00100000:1.0:1786960718.655046:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737856 00000100:00100000:1.0:1786960718.655071:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786960718.655078:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960718.655113:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960718.655144:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.655159:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786960718.655176:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737728 00000100:00100000:1.0:1786960718.655179:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737728 00000100:00100000:1.0:1786960718.655228:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737472 00000100:00100000:1.0:1786960718.655231:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737472 00000100:00100000:1.0:1786960718.655246:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786960718.655252:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967737728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655282:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967737728:12345-0@lo:400:kworker.0 Request processed in 30us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.655288:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786960718.655297:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786960718.655302:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655323:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737472:12345-0@lo:400:kworker.0 Request processed in 22us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960718.655329:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1786960718.655657:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766816e1f80 x1873763967737472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960718.655676:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737472:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655691:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967737344:0@lo:400:kworker.0 00010000:00080000:1.0:1786960718.655701:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69ce00 x1873763967737856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960718.655715:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960718.655760:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967737216:0@lo:400:kworker.0 00000100:00100000:3.0:1786960718.655768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967737088:12345-0@lo:400:kworker.0 Request processed in 955us (1533us total) trans 0 rc 0/0 00010000:00080000:1.0:1786960718.655776:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766816e1500 x1873763967737728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960718.655779:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:3.0:1786960718.655827:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960718.655833:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960718.655838:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960718.655838:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967737728:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655912:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967737088:0@lo:400:kworker.0 00000100:00100000:1.0:1786960718.655925:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967737600:0@lo:400:kworker.0 00000001:02000400:0.0:1786960718.680541:0:9460:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 17 05:58:37 EDT 2026 00010000:00010000:3.0:1786960719.092524:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960719.157368:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960719.157401:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960719.157493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960719.157806:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967737984 00000100:00100000:3.0:1786960719.157818:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967737984 00000100:00100000:3.0:1786960719.157885:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786960719.157897:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960719.157944:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960719.158016:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967737984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960719.158034:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1786960719.158143:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69e680 x1873763967737984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960719.158177:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967737984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786960720.116484:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960721.151578:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960722.165471:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960723.189733:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960723.631911:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960723.631984:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960723.632157:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268416 00000100:00100000:2.0:1786960723.632171:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268416 00000100:00100000:1.0:1786960723.632263:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268544 00000100:00100000:1.0:1786960723.632274:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268544 00000100:00100000:1.0:1786960723.632430:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1786960723.632444:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958268544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:2.0:1786960723.632496:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960723.632567:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958268544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 125us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960723.632576:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1786960723.632955:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:3.0:1786960723.632965:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958268416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960723.633000:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958268416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960723.633007:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:0.0:1786960723.764857:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960723.764900:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967738112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960723.765009:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960723.765213:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738112 00000100:00100000:3.0:1786960723.765223:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738112 00000100:00100000:3.0:1786960723.765305:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960723.765316:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967738112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960723.765359:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960723.765412:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967738112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960723.765419:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1786960723.765466:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69e680 x1873763967738112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960723.765486:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967738112:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786960723.765585:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960723.765827:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967738240:0@lo:400:kworker.0 00000100:00100000:3.0:1786960723.765864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960723.765945:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738240 00000100:00100000:1.0:1786960723.765951:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738240 00000100:00100000:1.0:1786960723.765987:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1786960723.765995:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967738240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766214:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967738624:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766250:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960723.766299:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967738496:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766326:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960723.766345:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786960723.766351:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967738368:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766394:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960723.766426:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738624 00000100:00100000:0.0:1786960723.766430:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738624 00000100:00100000:0.0:1786960723.766461:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738496 00000100:00100000:0.0:1786960723.766463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738496 00000100:00100000:0.0:1786960723.766474:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738368 00000100:00100000:0.0:1786960723.766476:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738368 00000100:00100000:0.0:1786960723.766487:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786960723.766493:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967738624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766527:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967738624:12345-0@lo:400:kworker.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960723.766534:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786960723.766546:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786960723.766552:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967738496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766578:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967738496:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960723.766584:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786960723.766609:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786960723.766615:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967738368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766640:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967738368:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960723.766646:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1786960723.766662:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960723.766681:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967738624:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766702:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967738368:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.766710:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967738496:0@lo:400:kworker.0 00000100:00100000:1.0:1786960723.769799:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967738240:12345-0@lo:400:kworker.0 Request processed in 3791us (3920us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960723.769818:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1786960723.770651:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960723.770675:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967738752:0@lo:400:kworker.0 00000100:00100000:0.0:1786960723.770763:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960723.770921:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738752 00000100:00100000:1.0:1786960723.770933:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738752 00000100:00100000:1.0:1786960723.771026:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786960723.771037:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967738752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960723.771113:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967738752:12345-0@lo:400:kworker.0 Request processed in 77us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960723.771136:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967738240:0@lo:400:kworker.0 00000100:00100000:1.0:1786960723.771141:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1786960723.771205:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766770a8000 x1873763967738752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960723.771225:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967738752:0@lo:400:kworker.0 00000100:00080000:0.0:1786960723.771393:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786960724.212453:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960724.281375:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967738880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960724.281481:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960724.288466:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967738880 00000100:00100000:2.0:1786960724.288488:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967738880 00000100:00100000:2.0:1786960724.288582:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786960724.288605:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967738880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960724.288670:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960724.288801:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967738880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (7319us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960724.288829:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1786960724.289237:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69e680 x1873763967738880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960724.289264:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967738880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786960725.240773:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960726.260658:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960727.291339:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960728.308739:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960728.739146:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960728.739291:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960728.739428:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268800 00000100:00100000:1.0:1786960728.739442:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268800 00000100:00100000:1.0:1786960728.739529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1786960728.739543:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958268800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960728.739647:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958268800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 108us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960728.739655:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00080000:0.0:1786960728.739780:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960728.739814:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268672 00000100:00100000:2.0:1786960728.739819:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268672 00000100:00100000:2.0:1786960728.739854:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:2.0:1786960728.739861:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958268672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960728.745138:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958268672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 5260us (5989us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960728.745157:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:0.0:1786960728.889573:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967739008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960728.889680:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960728.889803:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739008 00000100:00100000:0.0:1786960728.889813:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739008 00000100:00100000:0.0:1786960728.889883:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786960728.889896:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967739008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960728.889943:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960728.889997:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967739008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960728.890004:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1786960728.890045:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786960728.890083:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4000 x1873763967739008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960728.890121:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967739008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960728.890677:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967739136:0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.890734:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960728.890775:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967739648:0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.890777:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739136 00000100:00100000:1.0:1786960728.890784:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739136 00000100:00100000:1.0:1786960728.890822:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1786960728.890828:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960728.890845:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967739136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.890857:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960728.890866:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967739264:0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.890908:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967739136:12345-0@lo:400:kworker.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960728.890908:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960728.890919:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1786960728.890943:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967739136:0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.890970:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967739392:0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.890996:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960728.891022:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960728.891027:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967739520:0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.891050:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960728.891084:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739648 00000100:00100000:0.0:1786960728.891100:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739648 00000100:00100000:0.0:1786960728.891138:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786960728.891145:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.891416:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739264 00000100:00100000:1.0:1786960728.891421:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739264 00000100:00100000:1.0:1786960728.891448:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739392 00000100:00100000:1.0:1786960728.891451:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739392 00000100:00100000:1.0:1786960728.891466:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739520 00000100:00100000:1.0:1786960728.891468:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739520 00000100:00100000:1.0:1786960728.891483:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786960728.891489:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967739264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.891530:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967739264:12345-0@lo:400:kworker.0 Request processed in 41us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960728.891536:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786960728.891570:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786960728.891719:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967739392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.891768:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967739392:12345-0@lo:400:kworker.0 Request processed in 54us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960728.891775:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786960728.891788:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786960728.891794:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967739520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960728.891821:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967739520:12345-0@lo:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960728.891827:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1786960728.892306:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786960728.892313:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960728.893490:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967739648:12345-0@lo:400:kworker.0 Request processed in 2337us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960728.893503:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786960728.893716:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967739520:0@lo:400:kworker.0 00000100:00100000:2.0:1786960728.893732:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967739392:0@lo:400:kworker.0 00000100:00100000:0.0:1786960728.894265:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967739264:0@lo:400:kworker.0 00010000:00080000:0.0:1786960728.894301:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766770ab480 x1873763967739648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960728.894314:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967739648:0@lo:400:kworker.0 00010000:00010000:1.0:1786960729.332523:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960729.398711:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960729.398741:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967739776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960729.398826:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960729.398901:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739776 00000100:00100000:0.0:1786960729.398909:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739776 00000100:00100000:0.0:1786960729.398959:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786960729.398970:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967739776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960729.399016:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960729.399068:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967739776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960729.399083:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1786960729.399136:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766770bad80 x1873763967739776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960729.399159:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967739776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960730.356559:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960731.381910:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960732.407388:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960733.430368:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960733.847502:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960733.847567:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960733.847805:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269056 00000100:00100000:1.0:1786960733.847821:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269056 00000100:00100000:2.0:1786960733.847845:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958268928 00000100:00100000:2.0:1786960733.847850:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958268928 00000100:00100000:2.0:1786960733.847906:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:1.0:1786960733.847906:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1786960733.847918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958268928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960733.847918:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958269056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:0.0:1786960733.848001:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960733.848073:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958269056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 157us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960733.848082:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1786960733.858475:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958268928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 10540us (10971us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960733.858495:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:2.0:1786960734.004787:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967739904:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.004911:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.004994:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967740416:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005027:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.005057:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786960734.005063:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967740032:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005098:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.005120:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967740544:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005145:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.005217:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967740288:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.005264:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960734.005269:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967740160:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005291:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960734.005323:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740416 00000100:00100000:2.0:1786960734.005333:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740416 00000100:00100000:2.0:1786960734.005389:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740032 00000100:00100000:2.0:1786960734.005393:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740032 00000100:00100000:2.0:1786960734.005404:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740160 00000100:00100000:2.0:1786960734.005406:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740160 00000100:00100000:2.0:1786960734.005424:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960734.005435:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967740416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005495:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967740416:12345-0@lo:400:kworker.0 Request processed in 61us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960734.005502:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960734.005531:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786960734.005538:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967740032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005566:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967740032:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960734.005572:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786960734.005583:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786960734.005589:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967740160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005634:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967740160:12345-0@lo:400:kworker.0 Request processed in 45us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960734.005639:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786960734.005659:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740544 00000100:00100000:2.0:1786960734.005663:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740544 00000100:00100000:2.0:1786960734.005688:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740288 00000100:00100000:2.0:1786960734.005691:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740288 00000100:00100000:2.0:1786960734.005708:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786960734.005715:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967740544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005747:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967740544:12345-0@lo:400:kworker.0 Request processed in 33us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960734.005754:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786960734.005764:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786960734.005769:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967740288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005795:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967740288:12345-0@lo:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960734.005801:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1786960734.005821:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786960734.005827:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960734.005830:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960734.005865:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967740160:0@lo:400:kworker.0 00010000:00080000:2.0:1786960734.005880:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69e680 x1873763967740288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960734.005891:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967740288:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005921:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967740032:0@lo:400:kworker.0 00010000:00080000:2.0:1786960734.005944:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acaf480 x1873763967740544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960734.005954:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967740544:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.005963:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967740416:0@lo:400:kworker.0 00000100:00100000:3.0:1786960734.006731:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967739904 00000100:00100000:3.0:1786960734.006741:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967739904 00000100:00100000:3.0:1786960734.006837:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1786960734.006847:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960734.006919:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967739904:12345-0@lo:400:kworker.0 Request processed in 75us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960734.006926:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1786960734.007020:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967739904:0@lo:400:kworker.0 00000100:00100000:2.0:1786960734.007617:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960734.007632:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967740672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960734.007674:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960734.007755:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740672 00000100:00100000:0.0:1786960734.007760:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740672 00000100:00100000:0.0:1786960734.007803:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786960734.007820:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967740672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960734.007876:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960734.007923:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967740672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960734.007930:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1786960734.007967:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4000 x1873763967740672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960734.007996:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967740672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786960734.452415:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960734.516994:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960734.517017:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967740800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960734.517095:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960734.517155:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740800 00000100:00100000:3.0:1786960734.517174:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740800 00000100:00100000:3.0:1786960734.517297:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786960734.517308:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967740800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960734.517357:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960734.517539:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967740800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 232us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960734.517548:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1786960734.517663:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766770bb480 x1873763967740800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960734.517944:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967740800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786960735.478151:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786960735.750325:0:10089:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 05:58:54 (1786960734) === 00000100:00100000:1.0:1786960736.223687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.223752:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269184 00000100:00100000:2.0:1786960736.223764:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269184 00000100:00100000:2.0:1786960736.223834:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:2.0:1786960736.223847:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:8120:x1873763958269184:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786960736.223869:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960736.223893:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044e00/0x1808d16e4c97f599 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be10 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.223943:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044e00/0x1808d16e4c97f599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be10 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.223958:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044e00/0x1808d16e4c97f599 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be10 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.223970:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044e00, rc 0) 00000100:00100000:2.0:1786960736.224060:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269184:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 216us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.224087:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:0.0:1786960736.240833:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960736.241786:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269312 00000100:00100000:3.0:1786960736.241803:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269312 00000100:00100000:3.0:1786960736.241888:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:3.0:1786960736.241901:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269312:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786960736.242523:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269312:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 621us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960736.242534:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:0.0:1786960736.251865:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.251975:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269440 00000100:00100000:2.0:1786960736.251989:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269440 00000100:00100000:2.0:1786960736.252070:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:2.0:1786960736.252082:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269440:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786960736.252534:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269440:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 452us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.252543:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:0.0:1786960736.259518:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960736.261892:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269568 00000100:00100000:1.0:1786960736.261910:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269568 00000100:00100000:1.0:1786960736.262015:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:1.0:1786960736.262027:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8124:x1873763958269568:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960736.262428:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8124:x1873763958269568:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 402us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.262437:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:0.0:1786960736.284932:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960736.285089:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269696 00000100:00100000:3.0:1786960736.285104:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269696 00000100:00100000:2.0:1786960736.285523:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:2.0:1786960736.285538:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8124:x1873763958269696:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960736.285928:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8124:x1873763958269696:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 392us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.285937:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:0.0:1786960736.292683:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.292832:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269824 00000100:00100000:2.0:1786960736.292846:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269824 00000100:00100000:2.0:1786960736.292952:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:2.0:1786960736.292964:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:8120:x1873763958269824:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786960736.292985:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960736.293008:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045e00/0x1808d16e4c97f5a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be3a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.293048:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045e00/0x1808d16e4c97f5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be3a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.293061:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045e00/0x1808d16e4c97f5a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be3a expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.293090:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045e00, rc 0) 00000100:00100000:2.0:1786960736.293334:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:8120:x1873763958269824:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 371us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.293342:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1786960736.296052:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960736.296161:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958269952 00000100:00100000:1.0:1786960736.296173:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958269952 00000100:00100000:1.0:1786960736.297074:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:1.0:1786960736.297086:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:8120:x1873763958269952:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1786960736.297121:0:5804:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1786960736.297155:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786960736.297160:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786960736.297164:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786960736.297166:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1786960736.300261:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:8120:x1873763958269952:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 3160us (4205us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.300281:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:3.0:1786960736.310848:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.311036:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270080 00000100:00100000:2.0:1786960736.311050:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270080 00000100:00100000:2.0:1786960736.311124:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:2.0:1786960736.311136:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:8120:x1873763958270080:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786960736.311159:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960736.311218:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.311258:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.311273:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960736.311284:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:2.0:1786960736.311398:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8120:x1873763958270080:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 264us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.311406:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:0.0:1786960736.315107:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960736.315230:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270208 00000100:00100000:1.0:1786960736.315241:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270208 00000100:00100000:1.0:1786960736.315299:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:1.0:1786960736.315309:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8120:x1873763958270208:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1786960736.315688:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8120:x1873763958270208:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 379us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.315697:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:3.0:1786960736.317614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960736.317724:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270336 00000100:00100000:0.0:1786960736.317738:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270336 00000100:00100000:0.0:1786960736.317803:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:0.0:1786960736.317815:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8120:x1873763958270336:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786960736.318123:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8120:x1873763958270336:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 310us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960736.318131:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:3.0:1786960736.321371:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.321563:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270464 00000100:00100000:2.0:1786960736.321576:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270464 00000100:00100000:2.0:1786960736.321660:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:2.0:1786960736.321672:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8129:x1873763958270464:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960736.322416:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8129:x1873763958270464:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 742us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.322425:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:2.0:1786960736.327853:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960736.328857:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270592 00000100:00100000:1.0:1786960736.328871:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270592 00000100:00100000:1.0:1786960736.328952:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:1.0:1786960736.328962:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8129:x1873763958270592:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960736.329249:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:8129:x1873763958270592:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 288us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.329256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:3.0:1786960736.332483:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.332579:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270720 00000100:00100000:2.0:1786960736.332592:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270720 00000100:00100000:2.0:1786960736.332652:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1786960736.332663:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2340:x1873763958270720:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786960736.332709:0:5811:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987@192.168.203.23@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1786960736.332763:0:5811:0:(genops.c:1406:class_connect()) connect: client 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987, cookie 0x1808d16e4c97f5ae 00000004:00100000:2.0:1786960736.332801:0:5811:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786960736.333152:0:5811:0:(import.c:65:import_set_state_nolock()) ffff97667ab15800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960736.333291:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2340:x1873763958270720:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 628us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.333300:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:0.0:1786960736.333572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960736.334005:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271104 00000100:00100000:1.0:1786960736.334015:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271104 00000100:00100000:1.0:1786960736.334088:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1786960736.334101:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958271104:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960736.334171:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958271104:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 73us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.334179:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00080000:2.0:1786960736.334798:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960736.340251:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960736.340541:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270976 00000100:00100000:3.0:1786960736.340556:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270976 00000100:00100000:0.0:1786960736.341128:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1786960736.341141:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:8120:x1873763958270976:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786960736.341221:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786960736.341343:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:8120:x1873763958270976:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 204us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960736.341352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00080000:2.0:1786960736.341422:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960736.344093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.344489:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958270848 00000100:00100000:2.0:1786960736.344514:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958270848 00000100:00100000:2.0:1786960736.344582:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1786960736.344592:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:0:x1873763958270848:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786960736.344636:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786960736.344788:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960736.344799:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:0:x1873763958270848:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 208us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.344807:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1786960736.344878:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271232 00000100:00100000:3.0:1786960736.344884:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271232 00000100:00100000:3.0:1786960736.344916:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1786960736.344926:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+7:8120:x1873763958271232:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786960736.345140:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:8120:x1873763958271232:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 216us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960736.345149:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960736.349167:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960736.349273:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960736.349295:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960736.349398:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271616 00000100:00100000:3.0:1786960736.349411:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271616 00000100:00100000:3.0:1786960736.349481:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1786960736.349495:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:8120:x1873763958271616:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:3.0:1786960736.349940:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1786960736.350122:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:8120:x1873763958271616:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 630us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960736.350131:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1786960736.350539:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271360 00000100:00100000:2.0:1786960736.350616:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271360 00000100:00100000:2.0:1786960736.350659:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271488 00000100:00100000:2.0:1786960736.350664:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271488 00000100:00100000:1.0:1786960736.350668:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1786960736.350678:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1873763958271360:12345-192.168.203.23@tcp:8:mount.lustre.0 00000100:00100000:2.0:1786960736.350701:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1786960736.350709:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1873763958271488:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1786960736.350714:0:6659:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987@192.168.203.23@tcp t0 exp 0000000000000000 cur 218 last 0 00010000:00080000:2.0:1786960736.350734:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987@192.168.203.23@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1786960736.350771:0:6660:0:(genops.c:1406:class_connect()) connect: client 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987, cookie 0x1808d16e4c97f5bc 00002000:00100000:2.0:1786960736.350788:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987/ffff97667ab14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786960736.350819:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:1.0:1786960736.350888:0:6659:0:(genops.c:1406:class_connect()) connect: client 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987, cookie 0x1808d16e4c97f5b5 00002000:00100000:1.0:1786960736.350896:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987/ffff97666b709000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1786960736.350917:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786960736.351114:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786960736.351156:0:6660:0:(import.c:65:import_set_state_nolock()) ffff97667ab17800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1786960736.351160:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1786960736.351180:0:6659:0:(import.c:65:import_set_state_nolock()) ffff97666b70e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786960736.351421:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2340:x1873763958271360:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 741us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960736.351430:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1786960736.352565:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2340:x1873763958271488:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1843us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960736.352581:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00010000:00010000:1.0:1786960736.502943:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960737.525361:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786960738.157004:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000001:00100000:1.0:1786960738.166223:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00010000:00010000:1.0:1786960738.552485:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786960738.659527:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000100:00100000:1.0:1786960739.124462:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960739.124506:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967740928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960739.124583:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960739.124658:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967740928 00000100:00100000:2.0:1786960739.124671:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967740928 00000100:00100000:2.0:1786960739.124762:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786960739.124775:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967740928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960739.124821:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960739.124909:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967740928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960739.124918:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1786960739.124975:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4380 x1873763967740928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960739.125002:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967740928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786960739.125009:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960739.125359:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967741312:0@lo:400:kworker.0 00000100:00100000:0.0:1786960739.125364:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967741440:0@lo:400:kworker.0 00000100:00100000:3.0:1786960739.125424:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960739.125461:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741312 00000100:00100000:0.0:1786960739.125469:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741312 00000100:00100000:2.0:1786960739.125543:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967741184:0@lo:400:kworker.0 00000100:00100000:0.0:1786960739.125553:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786960739.125566:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967741312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960739.125648:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967741056:0@lo:400:kworker.0 00000100:00100000:2.0:1786960739.128261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960739.128362:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741184 00000100:00100000:2.0:1786960739.128392:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741184 00000100:00100000:2.0:1786960739.128448:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786960739.128459:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967741184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960739.128544:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967741184:12345-0@lo:400:kworker.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960739.128552:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786960739.128612:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967741184:0@lo:400:kworker.0 00000100:00100000:0.0:1786960739.130401:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967741312:12345-0@lo:400:kworker.0 Request processed in 4829us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960739.130417:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1786960739.130481:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960739.130509:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960739.130727:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967741312:0@lo:400:kworker.0 00000100:00100000:2.0:1786960739.130864:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741440 00000100:00100000:2.0:1786960739.130872:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741440 00000100:00100000:2.0:1786960739.131046:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786960739.131056:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967741440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960739.131116:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967741440:12345-0@lo:400:kworker.0 Request processed in 62us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960739.131121:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1786960739.134653:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960739.134854:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967741440:0@lo:400:kworker.0 00000100:00100000:1.0:1786960739.135047:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960739.135102:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967741568:0@lo:400:kworker.0 00000100:00100000:1.0:1786960739.135141:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960739.135963:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741568 00000100:00100000:3.0:1786960739.135973:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741568 00000100:00100000:3.0:1786960739.136047:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786960739.136057:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967741568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960739.136117:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967741568:12345-0@lo:400:kworker.0 Request processed in 63us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960739.136124:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1786960739.136162:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acad180 x1873763967741568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960739.136174:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967741568:0@lo:400:kworker.0 00000100:00080000:0.0:1786960739.136256:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960739.136569:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741056 00000100:00100000:2.0:1786960739.136574:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741056 00000100:00100000:2.0:1786960739.136612:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1786960739.136620:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967741056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960739.136658:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967741056:12345-0@lo:400:kworker.0 Request processed in 39us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960739.136664:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1786960739.137046:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967741056:0@lo:400:kworker.0 00010000:00010000:3.0:1786960739.577428:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960739.638286:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960739.638308:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967741696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960739.638377:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960739.640657:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741696 00000100:00100000:1.0:1786960739.640670:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741696 00000100:00100000:1.0:1786960739.640726:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786960739.640737:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967741696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960739.640779:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960739.640860:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967741696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2483us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960739.640867:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1786960739.641007:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e5880 x1873763967741696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960739.641038:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967741696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960740.596425:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960741.529082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960741.529267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960741.529307:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960741.529337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960741.529368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960741.529411:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272000 00000100:00100000:0.0:1786960741.529423:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272000 00000100:00100000:0.0:1786960741.529511:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271872 00000100:00100000:0.0:1786960741.529515:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271872 00000100:00100000:0.0:1786960741.529544:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1786960741.529555:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272000:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960741.529653:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272000:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 99us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960741.529661:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1786960741.529683:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1786960741.529690:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958271872:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960741.529840:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272256 00000100:00100000:2.0:1786960741.529846:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272256 00000100:00100000:2.0:1786960741.529878:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272128 00000100:00100000:2.0:1786960741.529882:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272128 00000100:00100000:2.0:1786960741.529910:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1786960741.529919:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272256:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960741.529954:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272256:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960741.529961:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1786960741.529974:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1786960741.529980:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272128:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960741.530007:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272128:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960741.530014:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00080000:2.0:1786960741.530067:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786960741.530072:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960741.530075:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960741.530290:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958271872:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 600us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960741.530298:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:1.0:1786960741.530815:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958271744 00000100:00100000:1.0:1786960741.530823:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958271744 00000100:00100000:1.0:1786960741.530873:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:1.0:1786960741.530882:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958271744:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960741.530941:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958271744:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 61us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960741.530949:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00010000:00010000:0.0:1786960741.620943:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960742.288659:0:10286:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1786960742.651315:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960743.670161:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960744.244518:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967742080:0@lo:400:kworker.0 00000100:00100000:3.0:1786960744.244623:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960744.244697:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786960744.244704:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967741952:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.244828:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967741824:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.244866:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960744.244903:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967742336:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.244949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960744.244973:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960744.244979:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967742208:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245007:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960744.245056:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741824 00000100:00100000:0.0:1786960744.245065:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741824 00000100:00100000:0.0:1786960744.245124:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1786960744.245134:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967741824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245223:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967741824:12345-0@lo:400:kworker.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960744.245231:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1786960744.245272:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742080 00000100:00100000:0.0:1786960744.245276:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742080 00000100:00100000:0.0:1786960744.245317:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742336 00000100:00100000:0.0:1786960744.245320:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742336 00000100:00100000:0.0:1786960744.245340:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786960744.245348:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967742080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245384:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967742080:12345-0@lo:400:kworker.0 Request processed in 37us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960744.245395:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786960744.245408:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786960744.245416:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967742336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245444:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967742336:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960744.245460:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786960744.245481:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742208 00000100:00100000:0.0:1786960744.245493:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742208 00000100:00100000:0.0:1786960744.245528:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786960744.245535:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967742208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245569:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967742208:12345-0@lo:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960744.245575:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1786960744.245598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960744.245604:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786960744.245668:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acadf80 x1873763967742208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960744.245687:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967742208:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245699:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967741824:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.245708:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967742336:0@lo:400:kworker.0 00000100:00100000:3.0:1786960744.246679:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960744.246801:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967742464:0@lo:400:kworker.0 00000100:00100000:3.0:1786960744.247245:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960744.247300:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967742080:0@lo:400:kworker.0 00000100:00100000:3.0:1786960744.247344:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967741952 00000100:00100000:3.0:1786960744.247351:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967741952 00000100:00100000:3.0:1786960744.247413:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786960744.247423:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967741952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960744.247494:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967741952:12345-0@lo:400:kworker.0 Request processed in 73us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960744.247501:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786960744.247529:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742464 00000100:00100000:3.0:1786960744.247532:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742464 00000100:00100000:3.0:1786960744.247982:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786960744.247991:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967742464:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786960744.248099:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960744.248288:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967742464:12345-0@lo:400:kworker.0 Request processed in 298us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960744.248295:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786960744.248335:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967741952:0@lo:400:kworker.0 00010000:00080000:3.0:1786960744.248351:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acae680 x1873763967742464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960744.248362:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967742464:0@lo:400:kworker.0 00000100:00100000:0.0:1786960744.251119:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960744.251152:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967742592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960744.251286:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960744.251908:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742592 00000100:00100000:2.0:1786960744.251918:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742592 00000100:00100000:2.0:1786960744.251989:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786960744.252002:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967742592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960744.252049:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960744.252175:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967742592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 176us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960744.252215:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1786960744.256704:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e5880 x1873763967742592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960744.256738:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967742592:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786960744.692393:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960744.765041:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967742720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960744.765153:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960744.765290:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742720 00000100:00100000:0.0:1786960744.765300:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742720 00000100:00100000:0.0:1786960744.765359:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786960744.765370:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967742720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960744.765426:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960744.765489:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967742720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960744.765516:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1786960744.765565:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acae680 x1873763967742720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960744.765589:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967742720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960745.716497:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960746.645939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960746.646291:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272384 00000100:00100000:1.0:1786960746.646306:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272384 00000100:00100000:3.0:1786960746.646444:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:3.0:1786960746.646466:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2341:x1873763958272384:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960746.646565:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2341:x1873763958272384:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 108us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960746.646596:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:1.0:1786960746.646654:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960746.646704:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272512 00000100:00100000:1.0:1786960746.646710:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272512 00000100:00100000:1.0:1786960746.646756:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:1.0:1786960746.646767:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958272512:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960746.646932:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960746.646985:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272768 00000100:00100000:3.0:1786960746.646992:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272768 00000100:00100000:3.0:1786960746.647041:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:3.0:1786960746.647049:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272768:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960746.647068:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958272512:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960746.647080:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:3.0:1786960746.647107:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958272768:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960746.647116:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00080000:1.0:1786960746.647127:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960746.647136:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960746.653176:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960746.653249:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960746.653478:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272896 00000100:00100000:0.0:1786960746.653488:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272896 00000100:00100000:0.0:1786960746.653551:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1786960746.653561:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958272896:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960746.653629:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958272896:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960746.653636:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00080000:1.0:1786960746.653713:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960746.654315:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958272640 00000100:00100000:3.0:1786960746.654332:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958272640 00000100:00100000:3.0:1786960746.654443:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:3.0:1786960746.654458:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958272640:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960746.654539:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958272640:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 85us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960746.654545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00080000:2.0:1786960746.654982:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786960746.742504:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960747.768443:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960748.790997:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960749.366370:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967742848:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366481:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366539:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967743360:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366567:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366598:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960749.366604:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967743232:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366659:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967742976:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366682:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366699:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967743488:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366738:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960749.366743:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967743104:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366782:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960749.366820:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742848 00000100:00100000:0.0:1786960749.366828:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742848 00000100:00100000:0.0:1786960749.366888:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1786960749.366899:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967742848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.366983:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967742848:12345-0@lo:400:kworker.0 Request processed in 86us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960749.366991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1786960749.367155:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743360 00000100:00100000:1.0:1786960749.367160:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743360 00000100:00100000:1.0:1786960749.367224:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967742976 00000100:00100000:1.0:1786960749.367227:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967742976 00000100:00100000:1.0:1786960749.367239:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743104 00000100:00100000:1.0:1786960749.367241:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743104 00000100:00100000:1.0:1786960749.367255:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786960749.367271:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967743360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960749.367310:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967743360:12345-0@lo:400:kworker.0 Request processed in 41us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960749.367316:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786960749.367330:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786960749.367336:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967742976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960749.367367:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967742976:12345-0@lo:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960749.367373:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786960749.367382:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786960749.367388:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967743104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960749.367414:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967743104:12345-0@lo:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960749.367429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1786960749.367447:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960749.367491:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967743104:0@lo:400:kworker.0 00000100:00100000:1.0:1786960749.367504:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967742976:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.367762:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743232 00000100:00100000:0.0:1786960749.367768:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743232 00000100:00100000:0.0:1786960749.367822:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743488 00000100:00100000:0.0:1786960749.367826:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743488 00000100:00100000:0.0:1786960749.367851:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786960749.367858:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967743232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.367898:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967743232:12345-0@lo:400:kworker.0 Request processed in 40us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960749.367904:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786960749.367916:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786960749.367922:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967743488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.367954:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967743488:12345-0@lo:400:kworker.0 Request processed in 32us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960749.367973:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1786960749.369615:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960749.369626:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786960749.369690:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d9180 x1873763967743488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960749.369708:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967743488:0@lo:400:kworker.0 00010000:00080000:0.0:1786960749.369797:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d8a80 x1873763967743232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960749.369810:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967743232:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.369826:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967742848:0@lo:400:kworker.0 00000100:00100000:0.0:1786960749.369865:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967743360:0@lo:400:kworker.0 00000100:00100000:1.0:1786960749.373234:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967743616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960749.373337:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960749.373436:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743616 00000100:00100000:1.0:1786960749.373445:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743616 00000100:00100000:1.0:1786960749.373508:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786960749.373519:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967743616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960749.373567:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960749.373626:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967743616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960749.373634:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1786960749.373689:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4700 x1873763967743616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960749.373713:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967743616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786960749.821012:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960749.877603:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960749.877635:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967743744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960749.877727:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960749.877812:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743744 00000100:00100000:1.0:1786960749.877822:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743744 00000100:00100000:1.0:1786960749.877884:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786960749.877894:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967743744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960749.877954:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960749.878015:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967743744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960749.878022:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1786960749.878070:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acaca80 x1873763967743744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960749.878091:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967743744:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960750.836362:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960751.766378:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960751.766439:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960751.766442:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273152 00000100:00100000:0.0:1786960751.766456:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273152 00000100:00100000:3.0:1786960751.766483:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960751.766510:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960751.766537:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273408 00000100:00100000:3.0:1786960751.766542:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273408 00000100:00100000:0.0:1786960751.766586:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273280 00000100:00100000:0.0:1786960751.766590:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273280 00000100:00100000:3.0:1786960751.766592:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1786960751.766602:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273408:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960751.766610:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1786960751.766616:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958273152:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960751.766706:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958273152:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 89us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960751.766714:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1786960751.766731:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:0.0:1786960751.766738:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273280:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960751.766849:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273408:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 247us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960751.766856:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1786960751.766879:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273024 00000100:00100000:3.0:1786960751.766882:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273024 00000100:00100000:3.0:1786960751.766916:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:3.0:1786960751.766923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958273024:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960751.769924:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273280:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 3174us (3400us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960751.769939:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00080000:0.0:1786960751.769983:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960751.769990:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960751.771014:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958273024:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 4075us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960751.771031:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:2.0:1786960751.777390:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960751.778091:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273536 00000100:00100000:0.0:1786960751.778104:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273536 00000100:00100000:0.0:1786960751.778182:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1786960751.778215:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273536:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960751.778313:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958273536:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 102us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960751.778321:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00080000:2.0:1786960751.782124:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786960751.860926:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960752.888075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960753.909399:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960754.484517:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967744256:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484593:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484652:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786960754.484659:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967743872:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484687:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484711:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967744384:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484733:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484760:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967744000:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484781:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484798:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967744512:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484818:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484836:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960754.484842:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967744128:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.484862:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960754.484893:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744256 00000100:00100000:1.0:1786960754.484901:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744256 00000100:00100000:1.0:1786960754.484952:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744512 00000100:00100000:1.0:1786960754.484955:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744512 00000100:00100000:1.0:1786960754.484977:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786960754.484985:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766812d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967744256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485035:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766812d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967744256:12345-0@lo:400:kworker.0 Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485041:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786960754.485224:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786960754.485231:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967744512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485267:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967744512:12345-0@lo:400:kworker.0 Request processed in 37us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485273:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786960754.485292:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967743872 00000100:00100000:1.0:1786960754.485295:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967743872 00000100:00100000:1.0:1786960754.485320:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786960754.485327:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967743872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485355:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967743872:12345-0@lo:400:kworker.0 Request processed in 29us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485361:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1786960754.485395:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744384 00000100:00100000:1.0:1786960754.485398:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744384 00000100:00100000:1.0:1786960754.485424:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744000 00000100:00100000:1.0:1786960754.485427:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744000 00000100:00100000:1.0:1786960754.485439:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744128 00000100:00100000:1.0:1786960754.485441:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744128 00000100:00100000:1.0:1786960754.485455:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786960754.485461:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967744384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485491:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967744384:12345-0@lo:400:kworker.0 Request processed in 30us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485496:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1786960754.485508:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786960754.485513:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967744000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485538:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967744000:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485553:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1786960754.485565:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786960754.485571:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967744128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485598:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967744128:12345-0@lo:400:kworker.0 Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960754.485604:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1786960754.485629:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786960754.485633:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960754.485636:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960754.485672:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967744128:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485683:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967744000:0@lo:400:kworker.0 00010000:00080000:1.0:1786960754.485694:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976681637480 x1873763967744512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960754.485705:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967744512:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485729:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967743872:0@lo:400:kworker.0 00000100:00100000:1.0:1786960754.485738:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967744384:0@lo:400:kworker.0 00010000:00080000:1.0:1786960754.485748:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ace4380 x1873763967744256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960754.485757:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967744256:0@lo:400:kworker.0 00000100:00100000:0.0:1786960754.485958:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960754.485975:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967744640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960754.486005:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960754.486076:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744640 00000100:00100000:3.0:1786960754.486080:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744640 00000100:00100000:3.0:1786960754.486118:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1786960754.486126:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967744640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960754.486153:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960754.486218:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967744640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960754.486224:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1786960754.486250:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acac000 x1873763967744640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960754.486263:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967744640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786960754.933450:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960754.999121:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960754.999144:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967744768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960754.999227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960754.999290:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744768 00000100:00100000:2.0:1786960754.999297:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744768 00000100:00100000:2.0:1786960754.999344:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786960754.999353:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967744768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960754.999397:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960754.999443:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967744768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960754.999450:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1786960754.999502:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e7b80 x1873763967744768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960754.999519:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967744768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960755.958429:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960756.888838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960756.888883:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960756.888928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960756.889088:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960756.889114:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960756.889138:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274048 00000100:00100000:3.0:1786960756.889146:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274048 00000100:00100000:3.0:1786960756.889219:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274176 00000100:00100000:3.0:1786960756.889222:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274176 00000100:00100000:3.0:1786960756.889244:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1786960756.889253:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2340:x1873763958274048:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:3.0:1786960756.889280:0:6659:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f5b5 00000100:00080000:3.0:1786960756.889289:0:6659:0:(import.c:65:import_set_state_nolock()) ffff97666b70e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960756.889323:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786960756.889677:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+2:2340:x1873763958274048:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 423us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960756.889684:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1786960756.889701:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1786960756.889707:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2340:x1873763958274176:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:3.0:1786960756.889719:0:6659:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f5bc 00000100:00080000:3.0:1786960756.889725:0:6659:0:(import.c:65:import_set_state_nolock()) ffff97667ab17800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960756.889744:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1786960756.889917:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+2:2340:x1873763958274176:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 209us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960756.889923:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00080000:3.0:1786960756.889946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960756.889949:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786960756.889963:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960756.890062:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960756.890616:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273664 00000100:00100000:0.0:1786960756.890623:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273664 00000100:00100000:0.0:1786960756.890669:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:0.0:1786960756.890677:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958273664:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960756.890724:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958273664:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 48us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960756.890731:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:2.0:1786960756.893781:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273920 00000100:00100000:2.0:1786960756.893799:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273920 00000100:00100000:1.0:1786960756.894554:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958273792 00000100:00100000:1.0:1786960756.894561:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958273792 00000100:00100000:3.0:1786960756.894858:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:3.0:1786960756.894873:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958273792:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960756.894963:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958273792:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 93us (6033us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960756.894971:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00080000:1.0:1786960756.895204:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960756.901541:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:3.0:1786960756.901555:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958273920:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960756.902563:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958273920:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1006us (13675us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960756.902574:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00080000:1.0:1786960756.903232:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786960756.980429:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960758.004428:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786960758.644600:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000020:00000080:0.0:1786960758.644609:0:7615:0:(genops.c:906:class_export_put()) final put ffff97667ab14800/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000020:00000080:0.0:1786960758.644645:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ab14800/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 for lustre-OST0001 00000020:00000080:0.0:1786960758.644684:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ab17800 for lustre-OST0001 00010000:00010000:1.0:1786960759.031402:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960759.206068:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000020:00000080:1.0:1786960759.206079:0:6685:0:(genops.c:906:class_export_put()) final put ffff97666b709000/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000020:00000080:0.0:1786960759.206153:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff97666b709000/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 for lustre-OST0000 00000020:00000080:0.0:1786960759.206228:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97666b70e000 for lustre-OST0000 00000100:00100000:1.0:1786960759.604385:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960759.604411:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967744896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960759.604474:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960759.604792:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967745280:0@lo:400:kworker.0 00000100:00100000:0.0:1786960759.604849:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960759.604873:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960759.604878:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967745408:0@lo:400:kworker.0 00000100:00100000:0.0:1786960759.604902:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960759.604926:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967744896 00000100:00100000:3.0:1786960759.604936:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967744896 00000100:00100000:0.0:1786960759.604944:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745280 00000100:00100000:0.0:1786960759.604950:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745280 00000100:00100000:0.0:1786960759.604996:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745408 00000100:00100000:0.0:1786960759.604999:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745408 00000100:00100000:3.0:1786960759.605015:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786960759.605024:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1786960759.605031:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967744896:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960759.605037:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967745280:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1786960759.605074:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960759.605086:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967745280:12345-0@lo:400:kworker.0 Request processed in 53us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960759.605104:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786960759.605123:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1786960759.605130:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967744896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960759.605136:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960759.605144:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786960759.605173:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967745408:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960759.605179:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786960759.605255:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967745408:0@lo:400:kworker.0 00000100:00100000:0.0:1786960759.605266:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967745280:0@lo:400:kworker.0 00010000:00080000:0.0:1786960759.605277:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667acae680 x1873763967744896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960759.605290:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967744896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960759.605435:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967745024:0@lo:400:kworker.0 00000100:00100000:2.0:1786960759.605471:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960759.605508:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967745536:0@lo:400:kworker.0 00000100:00100000:2.0:1786960759.605534:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960759.605560:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960759.605565:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967745152:0@lo:400:kworker.0 00000100:00100000:2.0:1786960759.605608:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960759.605635:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745536 00000100:00100000:2.0:1786960759.605645:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745152 00000100:00100000:2.0:1786960759.605651:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745152 00000100:00100000:3.0:1786960759.605653:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745536 00000100:00100000:2.0:1786960759.605685:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786960759.605693:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967745152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960759.605718:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786960759.605731:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967745536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960759.605737:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967745152:12345-0@lo:400:kworker.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960759.605745:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786960759.605780:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967745152:0@lo:400:kworker.0 00000100:00100000:3.0:1786960759.605790:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967745536:12345-0@lo:400:kworker.0 Request processed in 61us (251us total) trans 0 rc 0/0 00010000:00080000:2.0:1786960759.605798:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d8e00 x1873763967745536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960759.605799:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786960759.605810:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967745536:0@lo:400:kworker.0 00000100:00080000:1.0:1786960759.606103:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960759.606109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786960759.606111:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960759.606868:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745024 00000100:00100000:0.0:1786960759.606874:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745024 00000100:00100000:0.0:1786960759.606917:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1786960759.606934:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967745024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960759.606984:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967745024:12345-0@lo:400:kworker.0 Request processed in 51us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960759.606991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786960759.607084:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967745024:0@lo:400:kworker.0 00010000:00010000:0.0:1786960760.061056:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960760.116596:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960760.116624:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967745664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960760.116708:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960760.116786:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745664 00000100:00100000:2.0:1786960760.116794:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745664 00000100:00100000:2.0:1786960760.116853:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1786960760.116863:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967745664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960760.116918:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960760.120075:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967745664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3198us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960760.120093:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1786960760.129446:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e6a00 x1873763967745664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960760.129488:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967745664:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1786960760.218913:0:10990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1786960761.076592:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960762.006634:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960762.006716:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960762.006781:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274432 00000100:00100000:1.0:1786960762.006795:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274432 00000100:00100000:0.0:1786960762.006803:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960762.006845:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274560 00000100:00100000:0.0:1786960762.006855:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274560 00000100:00100000:1.0:1786960762.006890:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:1.0:1786960762.006913:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958274432:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960762.006997:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958274432:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 96us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960762.008270:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274304 00000100:00100000:3.0:1786960762.008282:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274304 00000100:00100000:3.0:1786960762.008362:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:3.0:1786960762.008378:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958274304:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960762.008460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958274304:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 88us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960762.008472:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:0.0:1786960762.008937:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:0.0:1786960762.008961:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958274560:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960762.009014:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958274560:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 68us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960762.009023:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00080000:0.0:1786960762.009295:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960762.013222:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00010000:00010000:3.0:1786960762.102453:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960763.125005:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786960763.980763:0:11137:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9531bad0 20000000:00000080:3.0:1786960763.980785:0:11137:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97667afb8c00 uarg=0000000000000000 20000000:01000000:3.0:1786960763.980831:0:11137:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960763.980839:0:11137:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960763.980846:0:11137:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1786960763.981850:0:11138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1786960763.982038:0:11137:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1786960763.988405:0:11137:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786960763.988449:0:11137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988475:0:11137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988485:0:11137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988492:0:11137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988498:0:11137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988521:0:11137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988529:0:11137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988646:0:11137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988663:0:11137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 12 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.988679:0:11137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967745792:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960763.988895:0:11137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.988905:0:11137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 18 pid: 5804 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.989340:0:11137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967745920:0@lo:104: 00000100:00100000:3.0:1786960763.989396:0:11137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960763.989444:0:11137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.989453:0:11137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 18 pid: 5803 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.989463:0:11137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746048:0@lo:104: 00000100:00100000:3.0:1786960763.989500:0:11137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960763.989613:0:11137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.989622:0:11137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 18 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.989631:0:11137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746176:0@lo:104: 00000100:00100000:3.0:1786960763.989653:0:11137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960763.989803:0:11137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.989822:0:11137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 12 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.989832:0:11137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746304:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960763.989879:0:11137:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648d23840 going to sleep for 11 seconds 00000100:00100000:1.0:1786960763.992248:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967745920 00000100:00100000:1.0:1786960763.992268:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967745920 00000100:00100000:1.0:1786960763.992350:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746048 00000100:00100000:1.0:1786960763.992354:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746048 00000100:00100000:1.0:1786960763.992367:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746176 00000100:00100000:1.0:1786960763.992370:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746176 00000100:00100000:1.0:1786960763.992389:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786960763.992400:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:11137:x1873763967745920:12345-0@lo:104: 00010000:00010000:1.0:1786960763.992437:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960763.992662:0:11137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967745920:0@lo:104: 00010000:00010000:1.0:1786960763.992742:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960763.992749:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:11137:x1873763967745920:12345-0@lo:104: Request processed in 352us (3353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960763.992757:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786960763.992777:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786960763.992784:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:11137:x1873763967746048:12345-0@lo:104: 00010000:00010000:1.0:1786960763.992791:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960763.992881:0:11137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746048:0@lo:104: 00010000:00010000:3.0:1786960763.995127:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786960763.995144:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995157:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7a00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960763.995162:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995174:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960763.995182:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960763.995231:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786960763.995332:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995339:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960763.995388:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995396:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9766743a7a00/0x1808d16e4c97f58b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995413:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960763.995416:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995421:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0e00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960763.995425:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995431:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960763.995437:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960763.995442:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1786960763.995466:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995474:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786960763.995474:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967746432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960763.995501:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995507:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0e00/0x1808d16e4c97f57d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f584 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960763.995518:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960763.995520:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960763.995522:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960763.995536:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967746560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960763.995572:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786960763.996221:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1786960763.996237:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:11137:x1873763967746048:12345-0@lo:104: Request processed in 3449us (6732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960763.996249:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786960763.996287:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786960763.996301:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:11137:x1873763967746176:12345-0@lo:104: 00010000:00010000:1.0:1786960763.996315:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960763.996397:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960763.996402:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:11137:x1873763967746176:12345-0@lo:104: Request processed in 108us (6749us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960763.996409:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1786960763.996486:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960763.996495:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960763.996506:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960763.996510:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960763.996583:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960763.996593:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960763.996601:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960763.996607:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786960763.996641:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960763.996648:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960763.996812:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960763.996822:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0600/0x1808d16e4c97f56f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960763.996843:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960763.996859:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960763.996860:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960763.997331:0:11137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acaea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746176:0@lo:104: 00000100:00100000:1.0:1786960763.997783:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1786960763.998486:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960763.999805:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967746688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786960764.000426:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960764.000818:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960764.000903:0:11137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967745792:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960764.002591:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960764.002602:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746432 00000100:00100000:2.0:1786960764.002617:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746432 00000100:00100000:0.0:1786960764.002637:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746560 00000100:00100000:0.0:1786960764.002646:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746560 00010000:00010000:2.0:1786960764.002733:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 20 pid: 5804 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960764.002762:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746688 00000100:00100000:2.0:1786960764.002893:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746688 00010000:00010000:2.0:1786960764.003942:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 21 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960764.003987:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274688 00000100:00100000:2.0:1786960764.004004:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274688 00010000:00010000:2.0:1786960764.004182:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 13 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960764.004222:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274816 00000100:00100000:2.0:1786960764.004226:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274816 00010000:00010000:2.0:1786960764.004239:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 14 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960764.004254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786960764.004264:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+21:3285:x1873763967746432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960764.004283:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960764.004291:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 21 pid: 5804 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004304:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 21 pid: 5804 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004365:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a7000/0x1808d16e4c97f592 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f58b expref: 21 pid: 5804 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004385:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960764.004481:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3285:x1873763967746432:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (8910us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960764.004489:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786960764.004542:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786960764.004558:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967746688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960764.004566:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960764.004571:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 19 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004579:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 19 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004588:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a600/0x1808d16e4c97f576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f56f expref: 19 pid: 5805 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004598:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960764.004633:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3288:x1873763967746688:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (4209us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960764.004640:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786960764.004655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1786960764.004661:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+14:2343:x1873763958274688:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960764.004671:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960764.004676:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 14 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004696:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 14 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004707:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044a00/0x1808d16e4c97f5a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be41 expref: 14 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004719:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960764.004768:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958274688:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 106us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960764.004774:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1786960764.004787:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1786960764.004793:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:2344:x1873763958274816:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960764.004802:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960764.004806:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 12 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004814:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 12 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.004824:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960764.004841:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:2344:x1873763958274816:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 47us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960764.004848:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1786960764.004924:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967746432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960764.004969:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967746688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786960764.005605:0:11137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045000/0x1808d16e4c97f568 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be09 expref: 11 pid: 5803 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960764.005621:0:11137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11137:1873763967746304:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960764.005661:0:11137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006167:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 17 pid: 5803 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960764.006341:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786960764.006358:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:3286:x1873763967746560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786960764.006374:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960764.006379:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 17 pid: 5803 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006392:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 17 pid: 5803 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006409:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045400/0x1808d16e4c97f584 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f57d expref: 17 pid: 5803 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006445:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006454:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006485:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006493:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006501:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006508:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006516:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960764.006520:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006528:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006566:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960764.006579:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960764.006661:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3286:x1873763967746560:12345-0@lo:103:ldlm_bl.0 Request processed in 312us (10159us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960764.006678:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786960764.006864:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967746560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960764.008653:0:11137:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960764.008673:0:11137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960764.008680:0:11137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169ac00/0x1808d16e4c97f5c3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960764.148458:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960764.724687:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967746944:0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.724782:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960764.724857:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967747456:0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.724888:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960764.724929:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960764.724935:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967747072:0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.724959:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960764.725001:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747456 00000100:00100000:0.0:1786960764.725011:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747456 00000100:00100000:0.0:1786960764.725085:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786960764.725097:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967747456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.725158:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967747456:12345-0@lo:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960764.725166:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786960764.725218:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746944 00000100:00100000:0.0:1786960764.725222:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746944 00000100:00100000:0.0:1786960764.725247:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747072 00000100:00100000:0.0:1786960764.725250:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747072 00000100:00100000:0.0:1786960764.725271:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786960764.725277:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967746944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.725305:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967746944:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960764.725311:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786960764.725345:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786960764.725351:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967747072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.725377:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967747072:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960764.725383:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1786960764.725398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960764.725403:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960764.725446:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967747072:0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.725455:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967746944:0@lo:400:kworker.0 00010000:00080000:0.0:1786960764.725590:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976681636300 x1873763967747456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960764.725603:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967747456:0@lo:400:kworker.0 00000100:00100000:2.0:1786960764.728421:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967746816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960764.728534:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960764.728607:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967747328:0@lo:400:kworker.0 00000100:00100000:2.0:1786960764.728637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960764.728684:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960764.728690:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967747200:0@lo:400:kworker.0 00000100:00100000:2.0:1786960764.728712:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960764.728757:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747200 00000100:00100000:2.0:1786960764.728767:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747200 00000100:00100000:2.0:1786960764.728834:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786960764.728845:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967747200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960764.728907:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967747200:12345-0@lo:400:kworker.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960764.728914:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1786960764.728940:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786960764.728992:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976681635c00 x1873763967747200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960764.729007:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967747200:0@lo:400:kworker.0 00000100:00100000:1.0:1786960764.729086:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747328 00000100:00100000:1.0:1786960764.729091:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747328 00000100:00100000:1.0:1786960764.729138:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786960764.729146:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967747328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960764.729224:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967747328:12345-0@lo:400:kworker.0 Request processed in 78us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960764.729230:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1786960764.729385:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960764.729406:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967747328:0@lo:400:kworker.0 00000100:00100000:0.0:1786960764.729591:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967746816 00000100:00100000:0.0:1786960764.729597:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967746816 00000100:00100000:0.0:1786960764.729625:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786960764.729633:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967746816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960764.729670:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960764.729727:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967746816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960764.729734:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1786960764.737722:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779db100 x1873763967746816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960764.737758:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967746816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960765.080425:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960765.080524:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958274944 00000100:00100000:1.0:1786960765.080538:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958274944 00000100:00100000:1.0:1786960765.080626:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:1.0:1786960765.080640:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:5583:x1873763958274944:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960765.080665:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960765.080692:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be6b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.080729:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.080742:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.080768:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6800, rc 0) 00000100:00100000:1.0:1786960765.080847:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958274944:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 209us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960765.080853:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:0.0:1786960765.088668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960765.088776:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275072 00000100:00100000:3.0:1786960765.088789:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275072 00000100:00100000:3.0:1786960765.088860:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:3.0:1786960765.088872:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958275072:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960765.089343:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958275072:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 471us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960765.089353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:0.0:1786960765.091797:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960765.091897:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275200 00000100:00100000:3.0:1786960765.091910:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275200 00000100:00100000:3.0:1786960765.092011:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:3.0:1786960765.092023:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958275200:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960765.092382:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958275200:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 360us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960765.092390:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:0.0:1786960765.100644:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960765.100870:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275328 00000100:00100000:1.0:1786960765.100884:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275328 00000100:00100000:1.0:1786960765.100964:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:1.0:1786960765.100976:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958275328:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960765.101000:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960765.101025:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be72 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.101063:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.101077:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.101088:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6600, rc 0) 00000100:00100000:1.0:1786960765.101171:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958275328:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 197us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960765.101180:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 233 10000000:01000000:2.0:1786960765.108355:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960765.108366:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e6000 from 7 10000000:01000000:2.0:1786960765.108372:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960765.108438:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.108451:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.108465:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960765.108498:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.108666:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.108773:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:3.0:1786960765.110670:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960765.117459:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747584 00000100:00100000:0.0:1786960765.117492:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747584 00000100:00100000:0.0:1786960765.117575:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275456 00000100:00100000:0.0:1786960765.117580:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275456 00000100:00100000:0.0:1786960765.117603:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1786960765.117628:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967747584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960765.117651:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960765.117674:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f5d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.117711:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.117725:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.117736:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960765.117836:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (9170us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.117844:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1786960765.117883:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:0.0:1786960765.117891:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958275456:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.118249:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958275456:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 357us (7592us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.118257:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:0.0:1786960765.118320:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960765.118342:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.118364:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960765.118453:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.118494:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960765.118531:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960765.118670:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747712 00000100:00100000:0.0:1786960765.118675:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747712 00000100:00100000:0.0:1786960765.118696:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786960765.118702:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.118864:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.118871:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786960765.118904:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.118938:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.118982:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960765.118997:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960765.119008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747840 00000100:00100000:0.0:1786960765.119012:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747840 00000100:00100000:0.0:1786960765.119028:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1786960765.119034:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.119250:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.119257:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1786960765.119302:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786960765.123535:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:1.0:1786960765.124284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960765.124356:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275584 00000100:00100000:1.0:1786960765.124370:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275584 00000100:00100000:1.0:1786960765.124435:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:1.0:1786960765.124464:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958275584:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960765.124814:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958275584:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 352us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960765.124822:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 238 00000020:01000000:2.0:1786960765.133097:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786960765.133130:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960765.133148:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.133164:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960765.133178:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960765.133181:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97667ad21800 from 7 10000000:01000000:2.0:1786960765.133214:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960765.133274:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.133283:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.133327:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960765.133368:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.133476:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.133547:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960765.133772:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967747968 00000100:00100000:0.0:1786960765.133785:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967747968 00000100:00100000:0.0:1786960765.133861:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1786960765.133874:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967747968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960765.133893:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960765.133916:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f5e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.133955:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.133970:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.133983:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0000, rc 0) 00000100:00100000:0.0:1786960765.134040:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967747968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.134047:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1786960765.134245:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967747968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960765.134262:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.134271:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960765.134352:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.134382:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.134411:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960765.134487:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748096 00000100:00100000:0.0:1786960765.134492:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748096 00000100:00100000:0.0:1786960765.134514:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1786960765.134521:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967748096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960765.135117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967748096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 593us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.135125:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1786960765.135296:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.135351:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.135400:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.135437:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:1.0:1786960765.135601:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748224 00000100:00100000:1.0:1786960765.135687:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748224 00000100:00100000:1.0:1786960765.135743:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1786960765.135752:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967748224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960765.136086:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967748224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960765.136096:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1786960765.136427:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786960765.139298:0:11163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786960765.143179:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786960765.143251:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960765.143268:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.143303:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960765.143325:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960765.143328:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff976652341800 from 7 10000000:01000000:2.0:1786960765.143331:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960765.143383:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.143392:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.143404:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960765.143437:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.143529:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.143693:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960765.144035:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748352 00000100:00100000:0.0:1786960765.144046:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748352 00000100:00100000:0.0:1786960765.144148:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1786960765.144160:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967748352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960765.144179:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960765.144221:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f5f4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.144253:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.144265:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.144274:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1000, rc 0) 00000100:00100000:0.0:1786960765.144339:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967748352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960765.144346:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1786960765.147758:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960765.147795:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960765.147810:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960765.147911:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960765.147999:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960765.149941:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a81ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960765.153211:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748480 00000100:00100000:2.0:1786960765.153233:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748480 00000100:00100000:2.0:1786960765.153325:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786960765.153340:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967748480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.155003:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967748480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1588us (6926us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960765.155019:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1786960765.155119:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.155222:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.155291:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960765.155341:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b780 going to sleep for 11 seconds 00000100:00100000:2.0:1786960765.155359:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748608 00000100:00100000:2.0:1786960765.155366:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748608 00000100:00100000:2.0:1786960765.155402:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1786960765.155412:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967748608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960765.156891:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967748608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1472us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960765.156906:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1786960765.164420:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967748608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786960765.170332:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1786960765.171946:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1786960765.171985:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960765.172002:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960765.172016:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960765.173799:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960765.238473:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967748736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960765.239085:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960765.239161:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748736 00000100:00100000:1.0:1786960765.239176:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748736 00000100:00100000:1.0:1786960765.239281:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786960765.239292:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967748736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960765.239352:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960765.239456:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967748736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960765.239463:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1786960765.240487:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766813e4000 x1873763967748736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960765.240520:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967748736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960766.199820:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960767.128114:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960767.128150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960767.128293:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960767.129386:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275712 00000100:00100000:1.0:1786960767.129397:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275712 00000100:00100000:1.0:1786960767.129517:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 245 00000100:00100000:1.0:1786960767.129528:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958275712:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960767.129656:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958275712:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 130us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960767.129664:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 245 00000100:00100000:3.0:1786960767.140015:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275968 00000100:00100000:3.0:1786960767.140030:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275968 00000100:00100000:3.0:1786960767.140158:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958275840 00000100:00100000:3.0:1786960767.140163:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958275840 00000100:00100000:3.0:1786960767.140215:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:3.0:1786960767.140225:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958275968:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960767.140316:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958275968:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (12164us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960767.140323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:3.0:1786960767.140354:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:3.0:1786960767.140362:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958275840:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960767.140387:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958275840:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (12094us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960767.140407:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00080000:0.0:1786960767.147103:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786960767.224558:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960768.252116:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786960768.503424:0:11336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1786960769.268443:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960769.844771:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960769.844794:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960769.844854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960769.845101:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748864 00000100:00100000:1.0:1786960769.845108:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748864 00000100:00100000:1.0:1786960769.845160:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786960769.845169:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967748864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960769.845216:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960769.845253:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967748864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960769.845260:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1786960769.845289:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960769.845533:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967749120:0@lo:400:kworker.0 00000100:00100000:1.0:1786960769.845563:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960769.845626:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967749376:0@lo:400:kworker.0 00000100:00100000:2.0:1786960769.845658:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960769.848838:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749120 00000100:00100000:0.0:1786960769.848865:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749120 00010000:00080000:3.0:1786960769.849157:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d8a80 x1873763967748864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960769.849182:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967748864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960769.849228:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967748992:0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.849670:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960769.849801:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967749504:0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.849829:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960769.849862:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967749248:0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.849884:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960769.849920:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749376 00000100:00100000:3.0:1786960769.849925:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749376 00000100:00100000:3.0:1786960769.849962:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749248 00000100:00100000:3.0:1786960769.849965:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749248 00000100:00100000:3.0:1786960769.849984:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786960769.849991:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967749376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.850032:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967749376:12345-0@lo:400:kworker.0 Request processed in 41us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960769.850038:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1786960769.850052:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1786960769.850066:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967749248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.850092:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967749248:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960769.850097:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1786960769.850113:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749504 00000100:00100000:3.0:1786960769.850116:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749504 00000100:00100000:3.0:1786960769.850140:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786960769.850146:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967749504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.850177:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967749504:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960769.850205:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786960769.850237:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967749248:0@lo:400:kworker.0 00000100:00080000:3.0:1786960769.850256:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960769.850260:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786960769.850274:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ae9d880 x1873763967749504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960769.850296:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967749504:0@lo:400:kworker.0 00000100:00100000:0.0:1786960769.853421:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786960769.853444:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967749120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960769.853547:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681634380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967749120:12345-0@lo:400:kworker.0 Request processed in 115us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960769.853553:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1786960769.854661:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967749120:0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.858201:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967749376:0@lo:400:kworker.0 00000100:00100000:2.0:1786960769.858502:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967748992 00000100:00100000:2.0:1786960769.858519:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967748992 00000100:00100000:2.0:1786960769.858584:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1786960769.858594:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967748992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960769.858905:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967748992:0@lo:400:kworker.0 00000100:00100000:2.0:1786960769.859056:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967748992:12345-0@lo:400:kworker.0 Request processed in 462us (9385us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960769.859064:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00010000:1.0:1786960770.292596:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960770.356814:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967749632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960770.356900:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960770.357395:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749632 00000100:00100000:0.0:1786960770.357404:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749632 00000100:00100000:0.0:1786960770.357523:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786960770.357534:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967749632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960770.357568:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960770.357629:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967749632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960770.357636:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1786960770.357722:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667a69d880 x1873763967749632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960770.357755:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967749632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960771.316364:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960772.256697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960772.256749:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960772.256790:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960772.256931:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276352 00000100:00100000:2.0:1786960772.256941:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276352 00000100:00100000:2.0:1786960772.257004:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276224 00000100:00100000:2.0:1786960772.257007:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276224 00000100:00100000:2.0:1786960772.257030:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:2.0:1786960772.257040:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958276352:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960772.257113:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681634000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958276352:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960772.257121:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:2.0:1786960772.257138:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:2.0:1786960772.257144:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958276224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960772.257166:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958276224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960772.257172:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00080000:1.0:1786960772.257402:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960772.258565:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276096 00000100:00100000:3.0:1786960772.258575:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276096 00000100:00100000:3.0:1786960772.258630:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 247 00000100:00100000:3.0:1786960772.258639:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2341:x1873763958276096:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960772.258709:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2341:x1873763958276096:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 63us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960772.258730:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 247 00010000:00010000:1.0:1786960772.341316:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960773.369677:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786960773.843763:0:11437:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 05:59:32 (1786960772) === 00000100:00100000:2.0:1786960774.158890:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960774.159061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960774.159180:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276608 00000100:00100000:0.0:1786960774.159246:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276608 00000100:00100000:3.0:1786960774.159423:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276480 00000100:00100000:3.0:1786960774.159429:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276480 00000100:00100000:3.0:1786960774.159554:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1786960774.159567:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958276480:12345-192.168.203.23@tcp:41:mkdir.0 00000100:00080000:1.0:1786960774.159610:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1786960774.159641:0:8734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786960774.160568:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1786960774.170397:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958276480:12345-192.168.203.23@tcp:41:mkdir.0 Request processed in 10823us (11509us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.170411:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1786960774.170692:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9675:x1873763958276608:12345-192.168.203.23@tcp:700:mkdir.0 00000100:00100000:0.0:1786960774.171068:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9675:x1873763958276608:12345-192.168.203.23@tcp:700:mkdir.0 Request processed in 10486us (12008us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960774.171077:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960774.184131:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.184416:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276864 00000100:00100000:1.0:1786960774.184425:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276864 00000100:00100000:1.0:1786960774.184499:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1786960774.184510:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9675:x1873763958276864:12345-192.168.203.23@tcp:36:mkdir.0 00010000:00010000:1.0:1786960774.184565:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960774.184639:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97f4e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdf4 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.184660:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976664f8c400) 00010000:00010000:1.0:1786960774.184690:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960774.189267:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.189290:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.189302:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.189358:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.189366:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.189380:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.192068:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786960774.192084:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192094:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192102:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192108:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a6400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.192113:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192120:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192135:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:1.0:1786960774.192137:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.192142:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.192148:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f602 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960774.192167:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed090a9b reply state 00000000e568d5e1 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960774.192206:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960774.192310:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9675:x1873763958276864:12345-192.168.203.23@tcp:36:mkdir.0 Request processed in 7798us (8185us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1786960774.192319:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:1.0:1786960774.202767:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202785:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202793:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202800:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.202804:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202812:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202839:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff976661496800) 00010000:00010000:1.0:1786960774.202842:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.202847:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.202853:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f609 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960774.221676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.222120:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958276992 00000100:00100000:1.0:1786960774.222134:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958276992 00000100:00100000:1.0:1786960774.222286:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1786960774.222298:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9676:x1873763958276992:12345-192.168.203.23@tcp:101:chmod.0 00010000:00010000:1.0:1786960774.222331:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.222361:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be79 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222449:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222465:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222489:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.222565:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786960774.222569:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960774.222626:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222660:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be79 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222682:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be79 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.222692:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:1.0:1786960774.222695:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960774.222699:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6400, rc 0) 00000100:00100000:1.0:1786960774.222775:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9676:x1873763958276992:12345-192.168.203.23@tcp:101:chmod.0 Request processed in 480us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.222791:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960774.228181:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960774.228571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958277248 00000100:00100000:0.0:1786960774.228585:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958277248 00000100:00100000:0.0:1786960774.228665:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960774.228690:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9676:x1873763958277248:12345-192.168.203.23@tcp:36:chmod.0 00010000:00010000:0.0:1786960774.228801:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960774.228843:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be79 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.228871:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:0.0:1786960774.228884:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960774.228922:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.228937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.228948:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960774.230159:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022287175 reply state 00000000175499f2 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960774.230178:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1786960774.230224:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1786960774.230563:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:9676:x1873763958277248:12345-192.168.203.23@tcp:36:chmod.0 Request processed in 1872us (2392us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786960774.230572:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00010000:00010000:3.0:1786960774.244343:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244364:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244372:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244379:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.244385:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244392:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244417:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559def00) 00010000:00010000:3.0:1786960774.244421:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960774.244426:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.244450:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f61e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960774.262260:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.263633:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958277376 00000100:00100000:1.0:1786960774.263649:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958277376 00000100:00100000:1.0:1786960774.263741:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1786960774.263754:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9677:x1873763958277376:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:1.0:1786960774.263787:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.263819:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be80 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.263908:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.263924:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.263938:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.264019:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786960774.264023:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960774.264073:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.264105:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be80 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.264128:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be80 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.264162:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:1.0:1786960774.264166:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960774.264170:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7000, rc 0) 00000100:00100000:1.0:1786960774.264317:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:9677:x1873763958277376:12345-192.168.203.23@tcp:101:chown.0 Request processed in 566us (2081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.264955:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1786960774.284939:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960774.285183:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958277504 00000100:00100000:0.0:1786960774.285240:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958277504 00000100:00100000:0.0:1786960774.285314:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1786960774.285337:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:9677:x1873763958277504:12345-192.168.203.23@tcp:101:chown.0 00010000:00010000:0.0:1786960774.285367:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960774.285395:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be87 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285504:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285522:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285536:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285554:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285562:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285570:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285958:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285967:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.285975:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960774.286025:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786960774.286030:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960774.286062:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286090:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286096:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286102:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286109:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960774.286114:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286123:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286139:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:0.0:1786960774.286142:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960774.286148:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286155:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1a00/0x1808d16e4c97f63a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286171:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286178:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286184:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286579:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960774.286583:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286591:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286601:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9766559dec00) 00010000:00010000:0.0:1786960774.286603:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960774.286606:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.286623:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.287863:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be87 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.287895:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be87 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.287904:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9766559de000) 00010000:00010000:0.0:1786960774.287907:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960774.287909:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0c00, rc 0) 00000100:00100000:2.0:1786960774.288879:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:9677:x1873763958277504:12345-192.168.203.23@tcp:101:chown.0 Request processed in 3531us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.288893:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1786960774.297461:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960774.297644:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958277760 00000100:00100000:0.0:1786960774.297658:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958277760 00000100:00100000:0.0:1786960774.297732:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1786960774.297743:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:9677:x1873763958277760:12345-192.168.203.23@tcp:36:chown.0 00010000:00010000:0.0:1786960774.297835:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960774.297870:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be87 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.297894:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9766559de000) 00010000:00010000:0.0:1786960774.297905:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960774.297936:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.297950:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.297961:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.391906:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786960774.394222:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1786960774.394346:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc710838 reply state 00000000e42f296f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960774.394363:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1786960774.394579:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1786960774.394730:0:8734:0:(ldlm_lib.c:3455:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1786960774.394759:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9677:x1873763958277760:12345-192.168.203.23@tcp:36:chown.0 Request processed in 97010us (97307us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1786960774.394769:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00010000:00010000:3.0:1786960774.395555:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395569:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395577:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395583:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.395588:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395596:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395615:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9766559dec00) 00010000:00010000:3.0:1786960774.395618:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960774.395622:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.395628:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f64f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960774.428082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.428853:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958277888 00000100:00100000:1.0:1786960774.428876:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958277888 00000100:00100000:1.0:1786960774.428954:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1786960774.428967:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9678:x1873763958277888:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:1.0:1786960774.428999:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.429027:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be8e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960774.431718:0:5812:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2621us 00010000:00010000:1.0:1786960774.455751:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.455803:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.455817:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.455838:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.455846:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.455853:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456600:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456612:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456621:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.456706:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786960774.456711:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960774.456816:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456833:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456852:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456971:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456981:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.456986:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.456994:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457010:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:1.0:1786960774.457014:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.457019:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457025:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f65d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457041:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457047:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457053:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457070:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.457080:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457087:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457102:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff976661496600) 00010000:00010000:1.0:1786960774.457105:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.457108:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457115:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457163:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be8e expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457179:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be8e expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.457268:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960774.457271:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786960774.457273:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6e00, rc 0) 00000100:00100000:1.0:1786960774.457554:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9678:x1873763958277888:12345-192.168.203.23@tcp:101:touch.500 Request processed in 28588us (29488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.457565:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1786960774.461748:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960774.462020:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958278144 00000100:00100000:2.0:1786960774.462035:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958278144 00000100:00100000:2.0:1786960774.462109:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1786960774.462121:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9678:x1873763958278144:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:2.0:1786960774.462149:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960774.462174:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f672 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be95 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.462570:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.462587:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.462599:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.464922:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.464945:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.464956:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960774.466825:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1786960774.467524:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f687 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467611:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467623:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f687 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467729:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467737:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467744:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467751:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960774.467755:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467764:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467776:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:2.0:1786960774.467780:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960774.467784:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.467790:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97f679 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960774.467815:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fb49f6c reply state 000000004c2d7024 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960774.467825:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786960774.467983:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f672 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be95 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.468000:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f687 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be95 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.468007:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976664f8ce00) 00010000:00010000:2.0:1786960774.468010:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960774.468013:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fe00, rc 0) 00000100:00100000:2.0:1786960774.468319:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:9678:x1873763958278144:12345-192.168.203.23@tcp:101:touch.500 Request processed in 6196us (6581us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1786960774.468330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00010000:00010000:3.0:1786960774.470026:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470055:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470062:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470068:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.470072:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470080:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470095:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff976664f8c800) 00010000:00010000:3.0:1786960774.470098:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960774.470101:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.470107:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e200/0x1808d16e4c97f680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960774.489339:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.489545:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958278400 00000100:00100000:3.0:1786960774.489555:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958278400 00000100:00100000:3.0:1786960774.489671:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:3.0:1786960774.489681:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:9678:x1873763958278400:12345-192.168.203.23@tcp:36:touch.500 00010000:00010000:3.0:1786960774.489734:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960774.489759:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f687 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be95 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.489788:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976664f8ce00) 00010000:00010000:3.0:1786960774.489798:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960774.489842:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.489854:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.489863:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960774.489997:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006453a518 reply state 0000000015c1d205 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960774.490006:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786960774.490096:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:9678:x1873763958278400:12345-192.168.203.23@tcp:36:touch.500 Request processed in 416us (766us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1786960774.490102:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00010000:00010000:3.0:1786960774.491815:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491828:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491835:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491841:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.491845:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491869:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491883:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976643e01900) 00010000:00010000:3.0:1786960774.491885:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960774.491889:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.491895:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f695 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960774.492293:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.492649:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958278528 00000100:00100000:1.0:1786960774.492658:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958278528 00000100:00100000:1.0:1786960774.492698:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1786960774.492715:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:9678:x1873763958278528:12345-192.168.203.23@tcp:101:touch.500 00010000:00010000:1.0:1786960774.492736:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.492753:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f69c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790be9c expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.492798:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f69c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be9c expref: 10 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.492807:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f69c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be9c expref: 10 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.492819:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976661496600) 00010000:00010000:1.0:1786960774.492821:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786960774.492823:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6200, rc 0) 00000100:00100000:1.0:1786960774.492864:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:9678:x1873763958278528:12345-192.168.203.23@tcp:101:touch.500 Request processed in 151us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.493110:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1786960774.497756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960774.497848:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958278656 00000100:00100000:2.0:1786960774.497857:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958278656 00000100:00100000:2.0:1786960774.497959:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1786960774.497967:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1873763958278656:12345-192.168.203.23@tcp:8:touch.500 00010000:00080000:2.0:1786960774.497995:0:6659:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1786960774.498025:0:6659:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97f6a3 00002000:00100000:2.0:1786960774.498035:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2d64e27-0ccc-4195-8812-2a972b8bf63c/ffff97667b0bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786960774.498069:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786960774.498339:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786960774.498366:0:6659:0:(import.c:65:import_set_state_nolock()) ffff97667b0bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960774.498424:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958278656:12345-192.168.203.23@tcp:8:touch.500 Request processed in 456us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.498431:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1786960774.500661:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.500788:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958278784 00000100:00100000:3.0:1786960774.500796:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958278784 00000100:00100000:3.0:1786960774.500906:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1786960774.500916:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:0:x1873763958278784:12345-192.168.203.23@tcp:2:touch.500 00000100:00080000:1.0:1786960774.503822:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960774.528568:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:0:x1873763958278784:12345-192.168.203.23@tcp:2:touch.500 Request processed in 27646us (27905us total) trans 4294967299 rc 0/0 00000001:00100000:1.0:1786960774.528735:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000001:00080000:1.0:1786960774.528751:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1786960774.529099:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960774.531753:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.531847:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958279040 00000100:00100000:3.0:1786960774.531857:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958279040 00000100:00100000:3.0:1786960774.531963:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1786960774.531974:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:9678:x1873763958279040:12345-192.168.203.23@tcp:35:touch.500 00000100:00100000:3.0:1786960774.532331:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:9678:x1873763958279040:12345-192.168.203.23@tcp:35:touch.500 Request processed in 359us (584us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1786960774.532336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1786960774.542545:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.542663:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958279168 00000100:00100000:1.0:1786960774.542673:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958279168 00000100:00100000:1.0:1786960774.542843:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1786960774.542854:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:9679:x1873763958279168:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:1.0:1786960774.542877:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.542898:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bea3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.542980:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.542994:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.543005:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.543061:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786960774.543065:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960774.543106:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.543130:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bea3 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.543146:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bea3 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.543155:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960774.543170:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960774.543173:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7c00, rc 0) 00000100:00100000:1.0:1786960774.543381:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:9679:x1873763958279168:12345-192.168.203.23@tcp:101:rm.0 Request processed in 529us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.543388:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1786960774.548542:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.549022:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958279424 00000100:00100000:1.0:1786960774.549031:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958279424 00000100:00100000:1.0:1786960774.549093:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1786960774.549102:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:9679:x1873763958279424:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:1.0:1786960774.549121:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.549139:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790beaa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960774.549464:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1786960774.549837:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beaa expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.549851:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:2.0:1786960774.549854:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960774.549859:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beaa expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960774.549871:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7e00, rc 0) 00000100:00100000:2.0:1786960774.549971:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:9679:x1873763958279424:12345-192.168.203.23@tcp:101:rm.0 Request processed in 869us (1436us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1786960774.549978:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1786960774.555052:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.555158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958279552 00000100:00100000:1.0:1786960774.555168:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958279552 00000100:00100000:0.0:1786960774.555547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1786960774.555560:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:9679:x1873763958279552:12345-192.168.203.23@tcp:37:rm.0 00000100:00100000:0.0:1786960774.561038:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:9679:x1873763958279552:12345-192.168.203.23@tcp:37:rm.0 Request processed in 5048us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960774.561052:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1786960774.564319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.564473:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958279808 00000100:00100000:3.0:1786960774.564492:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958279808 00000100:00100000:3.0:1786960774.564547:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1786960774.564557:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:9679:x1873763958279808:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:3.0:1786960774.565238:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:9679:x1873763958279808:12345-192.168.203.23@tcp:35:rm.0 Request processed in 680us (925us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1786960774.565271:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1786960774.569370:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.569471:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958280064 00000100:00100000:3.0:1786960774.569542:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958280064 00000100:00100000:3.0:1786960774.569833:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1786960774.569845:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:9679:x1873763958280064:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:3.0:1786960774.569881:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960774.569904:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f6c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790beb1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.570030:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f6cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.570045:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f6cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.570056:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f6cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960774.570067:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1786960774.570181:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f6c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb1 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.570217:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f6cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb1 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.570226:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:3.0:1786960774.570228:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786960774.570232:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ac00, rc 0) 00000100:00100000:3.0:1786960774.570310:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280064:12345-192.168.203.23@tcp:101:rm.0 Request processed in 468us (949us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1786960774.570317:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1786960774.574079:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960774.574333:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958280192 00000100:00100000:2.0:1786960774.574342:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958280192 00000100:00100000:2.0:1786960774.574436:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1786960774.574462:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280192:12345-192.168.203.23@tcp:41:rm.0 00000004:00000024:2.0:1786960774.574675:0:8734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1786960774.574780:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280192:12345-192.168.203.23@tcp:41:rm.0 Request processed in 320us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.574787:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:2.0:1786960774.577499:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.577645:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958280320 00000100:00100000:1.0:1786960774.577655:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958280320 00000100:00100000:1.0:1786960774.577708:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:1.0:1786960774.577719:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280320:12345-192.168.203.23@tcp:101:rm.0 00010000:00010000:1.0:1786960774.577739:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960774.577760:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f6db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790beb8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577822:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577836:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577846:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577860:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577868:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.577899:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578016:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578025:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578032:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.578058:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786960774.578062:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960774.578079:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578090:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578099:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578104:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578110:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578116:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.578119:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578132:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578143:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960774.578145:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.578150:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578156:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7e00/0x1808d16e4c97f6e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578167:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578172:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578177:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578182:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.578217:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578223:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578230:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff976661496300) 00010000:00010000:1.0:1786960774.578232:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.578235:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578260:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7a00/0x1808d16e4c97f6e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578289:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6400/0x1808d16e4c97f6db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb8 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578301:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb8 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.578308:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976661496600) 00010000:00010000:1.0:1786960774.578311:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960774.578313:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92c00, rc 0) 00000100:00100000:1.0:1786960774.578418:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:9679:x1873763958280320:12345-192.168.203.23@tcp:101:rm.0 Request processed in 700us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960774.578425:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1786960774.583059:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960774.583133:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958280576 00000100:00100000:2.0:1786960774.583141:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958280576 00000100:00100000:0.0:1786960774.583264:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960774.583286:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:9679:x1873763958280576:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:0.0:1786960774.583338:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786960774.583361:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97f6f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb8 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583380:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6200/0x1808d16e4c97f69c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be9c expref: 16 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583391:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff976661496600) 00010000:00010000:0.0:1786960774.583404:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7c00/0x1808d16e4c97f6b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bea3 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583412:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:0.0:1786960774.583415:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960774.583432:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583442:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583451:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583464:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583470:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583487:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583771:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583779:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.583786:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960774.585556:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1786960774.585570:0:8734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 256612382965ns, next at 257612380258ns, rc = 0 00010000:00010000:0.0:1786960774.585758:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585772:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585782:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585790:0:8734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585796:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585802:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585857:0:8734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960774.585885:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585901:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585908:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585914:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960774.585918:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585927:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585939:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9766559deb00) 00010000:00010000:0.0:1786960774.585942:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786960774.585945:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585952:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f705 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585968:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585974:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585980:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.585985:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960774.585993:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.586000:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.586008:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:0.0:1786960774.586011:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960774.586014:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960774.586020:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f6f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960774.586030:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdbd50a3 reply state 000000008833eab8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960774.586038:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960774.586124:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280576:12345-192.168.203.23@tcp:36:rm.0 Request processed in 2836us (3070us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1786960774.586133:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00010000:00010000:3.0:1786960774.592048:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960774.592062:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592073:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960774.592077:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592087:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592106:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9766559deb00) 00010000:00010000:3.0:1786960774.592109:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786960774.592114:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592121:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0200/0x1808d16e4c97f70c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592819:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592829:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592836:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592842:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.592860:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592879:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592891:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff9766559dee00) 00010000:00010000:3.0:1786960774.592894:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960774.592897:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.592903:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f6fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.593084:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960774.593087:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960774.593089:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960774.616833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960774.616988:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958280832 00000100:00100000:3.0:1786960774.616997:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958280832 00000100:00100000:3.0:1786960774.617052:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960774.617062:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:9679:x1873763958280832:12345-192.168.203.23@tcp:35:rm.0 00000100:00100000:3.0:1786960774.617405:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958280832:12345-192.168.203.23@tcp:35:rm.0 Request processed in 343us (580us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1786960774.617413:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1786960774.628654:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960774.628787:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281088 00000100:00100000:1.0:1786960774.628798:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281088 00000100:00100000:1.0:1786960774.628870:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1786960774.628881:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:9679:x1873763958281088:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:1.0:1786960774.628943:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786960774.628969:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f6cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790beb1 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.628991:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c97f66b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be8e expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629017:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960774.629035:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c97f62c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be80 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629044:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496a00) 00010000:00010000:1.0:1786960774.629050:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960774.629074:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629086:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629095:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629106:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629113:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629120:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629481:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629490:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.629507:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960774.631052:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786960774.631072:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631081:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631088:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631094:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.631097:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631104:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631116:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960774.631118:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786960774.631122:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631127:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f721 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631148:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631153:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631167:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631171:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960774.631174:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631179:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631218:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496300) 00010000:00010000:1.0:1786960774.631221:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960774.631224:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960774.631229:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f713 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960774.631241:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028da9cf3 reply state 00000000378a66a1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960774.631260:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960774.631338:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:9679:x1873763958281088:12345-192.168.203.23@tcp:36:rm.0 Request processed in 2457us (2691us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786960774.631347:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00010000:00010000:3.0:1786960774.634222:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634238:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634255:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634263:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960774.634280:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634287:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634303:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff976661496b00) 00010000:00010000:3.0:1786960774.634306:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960774.634310:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960774.634316:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f71a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960774.967931:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967749888:0@lo:400:kworker.0 00000100:00100000:3.0:1786960774.968010:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960774.968072:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967750400:0@lo:400:kworker.0 00000100:00100000:3.0:1786960774.968100:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960774.968127:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960774.968133:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967750016:0@lo:400:kworker.0 00000100:00100000:3.0:1786960774.968154:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960774.968314:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967750144:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960774.968374:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786960774.968380:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967749760:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968406:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960774.968428:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967750272:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968448:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960774.968477:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750400 00000100:00100000:2.0:1786960774.968484:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750400 00000100:00100000:2.0:1786960774.968532:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750144 00000100:00100000:2.0:1786960774.968535:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750144 00000100:00100000:2.0:1786960774.968555:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786960774.968565:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967750400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968627:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967750400:12345-0@lo:400:kworker.0 Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.968634:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786960774.968649:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786960774.968656:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967750144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968704:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967750144:12345-0@lo:400:kworker.0 Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.968711:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786960774.968728:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749760 00000100:00100000:2.0:1786960774.968732:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749760 00000100:00100000:2.0:1786960774.968754:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1786960774.968759:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967749760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968790:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967749760:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.968796:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1786960774.968841:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967749760:0@lo:400:kworker.0 00010000:00080000:2.0:1786960774.968855:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976648d7b800 x1873763967750144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960774.968865:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967750144:0@lo:400:kworker.0 00010000:00080000:2.0:1786960774.968909:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976648d79c00 x1873763967750400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960774.968917:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967750400:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.968932:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967749888 00000100:00100000:2.0:1786960774.968934:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967749888 00000100:00100000:2.0:1786960774.968953:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750016 00000100:00100000:2.0:1786960774.968955:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750016 00000100:00100000:2.0:1786960774.968968:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750272 00000100:00100000:2.0:1786960774.968970:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750272 00000100:00100000:2.0:1786960774.968983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1786960774.968989:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967749888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.969035:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967749888:12345-0@lo:400:kworker.0 Request processed in 45us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.969041:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1786960774.969055:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786960774.969062:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967750016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.969089:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967750016:12345-0@lo:400:kworker.0 Request processed in 28us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.969095:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1786960774.969105:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786960774.969110:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967750272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.969137:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967750272:12345-0@lo:400:kworker.0 Request processed in 28us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960774.969143:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1786960774.969167:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967750272:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.969221:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967750016:0@lo:400:kworker.0 00000100:00100000:2.0:1786960774.969231:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967749888:0@lo:400:kworker.0 00000100:00100000:0.0:1786960774.969471:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960774.969480:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967750528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960774.969508:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960774.969539:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750528 00000100:00100000:0.0:1786960774.969543:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750528 00000100:00100000:0.0:1786960774.969567:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786960774.969573:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967750528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960774.969587:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960774.969640:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967750528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960774.969646:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1786960774.969673:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97667ae9ea00 x1873763967750528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960774.969688:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967750528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786960774.969785:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786960774.969789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960774.969791:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1786960775.423234:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960775.476472:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967750656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960775.476539:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960775.476855:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750656 00000100:00100000:2.0:1786960775.476864:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750656 00000100:00100000:2.0:1786960775.476914:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786960775.476928:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967750656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960775.476965:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960775.477260:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967750656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 336us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960775.477279:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1786960775.479719:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976677b69180 x1873763967750656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960775.479745:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967750656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960776.436901:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960777.381367:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960777.381403:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960777.381440:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960777.381479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281216 00000100:00100000:1.0:1786960777.381490:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281216 00000100:00100000:1.0:1786960777.381547:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:1.0:1786960777.381557:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958281216:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960777.381645:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958281216:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960777.381653:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 249 00000100:00100000:1.0:1786960777.381714:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960777.381854:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281472 00000100:00100000:1.0:1786960777.381858:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281472 00000100:00100000:1.0:1786960777.381894:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:1.0:1786960777.381901:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958281472:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960777.381932:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958281472:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960777.381938:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1786960777.382342:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281344 00000100:00100000:3.0:1786960777.382348:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281344 00000100:00100000:3.0:1786960777.382403:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281600 00000100:00100000:3.0:1786960777.382407:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281600 00000100:00100000:3.0:1786960777.382433:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:3.0:1786960777.382442:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2343:x1873763958281344:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960777.382496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2343:x1873763958281344:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 56us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960777.382518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:3.0:1786960777.382535:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1786960777.382542:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958281600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960777.382573:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958281600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 31us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960777.382579:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00080000:1.0:1786960777.382725:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786960777.382731:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786960777.467474:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960778.484515:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960779.508842:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786960779.558778:0:11587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1786960779.644069:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1786960779.644082:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1786960779.644103:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:3.0:1786960779.645957:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967750784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786960779.646022:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960779.654628:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750784 00000100:00100000:2.0:1786960779.654642:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750784 00000100:00100000:2.0:1786960779.654715:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786960779.654725:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967750784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1786960779.654757:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1786960779.654794:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a82db87, atime: 0x6a82db87, ctime: 0x6a82db87, blocks: 0x1 00010000:00010000:2.0:1786960779.654803:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960779.654818:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=261s v=(0 0) 00010000:00010000:2.0:1786960779.654823:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960779.654830:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786960779.654840:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786960779.654850:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960779.654861:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960779.654868:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960779.654901:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960779.654935:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960779.655011:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960779.655026:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960779.655055:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960779.655069:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960779.655101:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960779.655110:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7662b5b/0x1808d16e4c97f728 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960779.655146:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960779.655149:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960779.655151:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960779.655633:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967750784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 907us (9607us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1786960779.655643:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1786960779.659063:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff976677b69c00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1786960779.659078:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967750784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786960780.084434:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960780.084465:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967750912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960780.084526:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960780.084583:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967750912 00000100:00100000:1.0:1786960780.084589:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967750912 00000100:00100000:1.0:1786960780.084634:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786960780.084642:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967750912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960780.084674:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960780.084714:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967750912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960780.084721:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786960780.084765:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967750912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960780.092162:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967751040:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.092279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.092317:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967751552:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.092344:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.092383:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960780.092389:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967751424:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.092414:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.092758:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967751296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.092786:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.092810:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786960780.092815:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967751168:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.092849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.092881:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751552 00000100:00100000:3.0:1786960780.092889:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751552 00000100:00100000:3.0:1786960780.092945:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786960780.092954:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967751552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.093004:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967751552:12345-0@lo:400:kworker.0 Request processed in 51us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960780.093011:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786960780.093034:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751424 00000100:00100000:3.0:1786960780.093038:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751424 00000100:00100000:3.0:1786960780.093064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751296 00000100:00100000:3.0:1786960780.093067:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751296 00000100:00100000:3.0:1786960780.093080:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751168 00000100:00100000:3.0:1786960780.093082:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751168 00000100:00100000:3.0:1786960780.093094:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786960780.093099:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967751424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.093129:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967751424:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960780.093136:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1786960780.093149:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786960780.093154:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967751296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.093182:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967751296:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960780.093207:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786960780.093232:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786960780.093238:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967751168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960780.093361:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751040 00000100:00100000:2.0:1786960780.093366:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751040 00000100:00100000:2.0:1786960780.093396:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786960780.093403:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967751040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1786960780.097430:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960780.097450:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960780.101344:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967751040:12345-0@lo:400:kworker.0 Request processed in 7933us (9056us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.101359:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786960780.101456:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967751424:0@lo:400:kworker.0 00000100:00100000:2.0:1786960780.101470:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967751040:0@lo:400:kworker.0 00010000:00080000:2.0:1786960780.101483:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976677b69880 x1873763967751552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960780.101493:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967751552:0@lo:400:kworker.0 00000100:00100000:2.0:1786960780.101542:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967751296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960780.103733:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967751168:12345-0@lo:400:kworker.0 Request processed in 10488us (10876us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960780.103756:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1786960780.108108:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967751168:0@lo:400:kworker.0 00010000:00010000:0.0:1786960780.535224:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960780.600048:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960780.600143:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960780.600402:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751680 00000100:00100000:3.0:1786960780.600413:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751680 00000100:00100000:3.0:1786960780.600670:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786960780.600685:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967751680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960780.600736:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960780.600804:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967751680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960780.600812:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1786960780.600884:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976648d7b100 x1873763967751680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960780.600907:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967751680:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1786960780.852379:0:11636:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff23a19ed0 20000000:00000080:2.0:1786960780.852395:0:11636:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97667d7c2800 uarg=0000000000000000 20000000:01000000:2.0:1786960780.852429:0:11636:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786960780.852435:0:11636:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786960780.852440:0:11636:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1786960780.857947:0:11637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1786960780.858218:0:11636:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1786960780.868449:0:11636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1786960780.868608:0:11636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1786960780.868663:0:11636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1786960780.868680:0:11636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786960780.868699:0:11636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868716:0:11636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868725:0:11636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868733:0:11636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868740:0:11636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868746:0:11636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868759:0:11636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868794:0:11636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868808:0:11636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 18 pid: 5805 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960780.868822:0:11636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967751808:0@lo:104: 00000100:00100000:3.0:1786960780.868881:0:11636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960780.868942:0:11636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.868950:0:11636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960780.868957:0:11636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967751936:0@lo:104: 00000100:00100000:3.0:1786960780.868991:0:11636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960780.869026:0:11636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.869033:0:11636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 18 pid: 5804 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960780.869041:0:11636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752064:0@lo:104: 00000100:00100000:3.0:1786960780.869065:0:11636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960780.869083:0:11636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.869102:0:11636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 12 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960780.869112:0:11636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752192:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960780.869164:0:11636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960780.869172:0:11636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 12 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960780.869180:0:11636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752320:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960780.869234:0:11636:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960780.869944:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786960780.869957:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751808 00000100:00100000:2.0:1786960780.869964:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751808 00000100:00100000:2.0:1786960780.869995:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967751936 00000100:00100000:2.0:1786960780.869997:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967751936 00000100:00100000:2.0:1786960780.870005:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752064 00000100:00100000:2.0:1786960780.870007:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752064 00000100:00100000:2.0:1786960780.870029:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786960780.870036:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:11636:x1873763967751808:12345-0@lo:104: 00010000:00010000:2.0:1786960780.870049:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.870100:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960780.870105:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+5:11636:x1873763967751808:12345-0@lo:104: Request processed in 70us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.870111:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786960780.870124:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786960780.870129:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:11636:x1873763967751936:12345-0@lo:104: 00010000:00010000:2.0:1786960780.870135:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.870163:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786960780.870167:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+4:11636:x1873763967751936:12345-0@lo:104: Request processed in 39us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.870173:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786960780.870181:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786960780.870218:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:11636:x1873763967752064:12345-0@lo:104: 00010000:00010000:2.0:1786960780.870226:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.870249:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786960780.870254:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+3:11636:x1873763967752064:12345-0@lo:104: Request processed in 68us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.870259:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1786960780.870331:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786960780.870338:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870345:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960780.870349:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870357:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960780.870365:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960780.870370:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786960780.870404:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870410:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960780.870427:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870443:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c97f5f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5fb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870456:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786960780.870458:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870464:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ee00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960780.870473:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870479:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960780.870486:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960780.870491:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786960780.870606:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870613:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960780.870626:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870633:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5ee00/0x1808d16e4c97f5e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5ed expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870642:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960780.870645:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870649:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960780.870652:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870659:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960780.870676:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960780.870681:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786960780.870692:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870698:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960780.870703:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870710:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5fc00/0x1808d16e4c97f5d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c97f5df expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.870722:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960780.870723:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960780.870725:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960780.870755:0:11636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967751808:0@lo:104: 00000100:00100000:1.0:1786960780.870763:0:11636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967751936:0@lo:104: 00000100:00100000:1.0:1786960780.870770:0:11636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752064:0@lo:104: 00000100:00100000:2.0:1786960780.870828:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967752704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960780.870861:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960780.870899:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960780.870904:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667acadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967752576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960780.870921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960780.871756:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752704 00000100:00100000:1.0:1786960780.871762:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752704 00010000:00010000:1.0:1786960780.871787:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 19 pid: 5804 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960780.871811:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752576 00000100:00100000:1.0:1786960780.871814:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752576 00010000:00010000:1.0:1786960780.871826:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 20 pid: 5803 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960780.871854:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786960780.871861:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+20:3288:x1873763967752704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786960780.871872:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960780.871877:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 20 pid: 5804 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.871887:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 20 pid: 5804 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.871901:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e0600/0x1808d16e4c97f5df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f5d8 expref: 20 pid: 5804 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.871913:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960780.871946:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967752704:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960780.871953:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786960780.871965:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786960780.871971:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3288:x1873763967752576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786960780.871977:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960780.871981:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.871989:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.871998:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e0000/0x1808d16e4c97f5ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f5e6 expref: 18 pid: 5803 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.872016:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960780.872035:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:3288:x1873763967752576:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960780.872041:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786960780.872133:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967752576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960780.872141:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667acafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967752704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960780.872248:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967752448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960780.872275:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786960780.872308:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960780.872469:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752448 00000100:00100000:0.0:1786960780.872477:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752448 00010000:00010000:0.0:1786960780.872493:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 17 pid: 5805 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960780.872611:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786960780.872618:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:3286:x1873763967752448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786960780.872626:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960780.872630:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 17 pid: 5805 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960780.872639:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 17 pid: 5805 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960780.872649:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1000/0x1808d16e4c97f5fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c97f5f4 expref: 17 pid: 5805 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960780.872659:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960780.872690:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3286:x1873763967752448:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960780.872696:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786960780.872738:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967752448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786960780.874877:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960780.874913:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960780.874969:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281728 00000100:00100000:2.0:1786960780.874977:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281728 00010000:00010000:2.0:1786960780.875006:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 13 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960780.875043:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281856 00000100:00100000:2.0:1786960780.875047:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281856 00010000:00010000:2.0:1786960780.875060:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 14 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960780.875078:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1786960780.875086:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+14:2344:x1873763958281728:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960780.875098:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960780.875103:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 14 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875115:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 14 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875148:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960780.875231:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+14:2344:x1873763958281728:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 144us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.875238:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1786960780.875255:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1786960780.875262:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958281856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960780.875271:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960780.875275:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 13 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875285:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 13 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875296:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875304:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875319:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875327:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875333:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875341:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875354:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960780.875358:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875366:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875375:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960780.875384:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960780.875404:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958281856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 142us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960780.875410:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00010000:00010000:1.0:1786960780.875559:0:11636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6600/0x1808d16e4c97f5d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be72 expref: 12 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960780.875573:0:11636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752192:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960780.875584:0:11636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6800/0x1808d16e4c97f5ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be6b expref: 11 pid: 5803 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960780.875592:0:11636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11636:1873763967752320:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960780.875619:0:11636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.875628:0:11636:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.875634:0:11636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960780.875640:0:11636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a000/0x1808d16e4c97f72f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960781.557055:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960782.486792:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.486831:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.486858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.486900:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.486926:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282112 00000100:00100000:1.0:1786960782.486935:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282112 00000100:00100000:1.0:1786960782.486978:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282368 00000100:00100000:1.0:1786960782.486980:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282368 00000100:00100000:1.0:1786960782.486999:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:1.0:1786960782.487009:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958282112:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960782.487074:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958282112:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.487081:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:1.0:1786960782.487096:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:1.0:1786960782.487102:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958282368:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960782.487139:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2341:x1873763958282368:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.487145:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1786960782.487443:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958281984 00000100:00100000:2.0:1786960782.487448:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958281984 00000100:00100000:2.0:1786960782.487483:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:2.0:1786960782.487490:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2341:x1873763958281984:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960782.487516:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2341:x1873763958281984:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.487532:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 251 00000100:00100000:0.0:1786960782.487779:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282240 00000100:00100000:0.0:1786960782.487783:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282240 00000100:00100000:0.0:1786960782.487821:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:0.0:1786960782.487829:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958282240:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960782.487856:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958282240:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960782.487869:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00080000:0.0:1786960782.487886:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960782.487890:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786960782.584170:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960782.678038:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.678329:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282496 00000100:00100000:1.0:1786960782.678340:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282496 00000100:00100000:1.0:1786960782.678397:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:1.0:1786960782.678407:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:5583:x1873763958282496:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960782.678425:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960782.678455:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e93200/0x1808d16e4c97f736 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bebf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960782.678688:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e93200/0x1808d16e4c97f736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bebf expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960782.678702:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e93200/0x1808d16e4c97f736 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bebf expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960782.678724:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93200, rc 0) 00000100:00100000:1.0:1786960782.678781:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958282496:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 376us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.678789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 252 00000100:00100000:0.0:1786960782.682760:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960782.682978:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282624 00000100:00100000:3.0:1786960782.682988:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282624 00000100:00100000:3.0:1786960782.683038:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 253 00000100:00100000:3.0:1786960782.683047:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958282624:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960782.683337:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958282624:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 290us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960782.683345:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 253 00000100:00100000:3.0:1786960782.685508:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960782.685772:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282752 00000100:00100000:2.0:1786960782.685781:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282752 00000100:00100000:2.0:1786960782.685826:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:2.0:1786960782.685835:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958282752:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.686037:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958282752:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 202us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.686045:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 254 00000100:00100000:2.0:1786960782.694651:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.694960:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958282880 00000100:00100000:1.0:1786960782.694968:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958282880 00000100:00100000:1.0:1786960782.695021:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00100000:1.0:1786960782.695032:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:9950:x1873763958282880:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960782.695317:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:9950:x1873763958282880:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 286us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.695325:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 255 00000100:00100000:0.0:1786960782.701419:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960782.701585:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283008 00000100:00100000:3.0:1786960782.701594:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283008 00000100:00100000:3.0:1786960782.701653:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:3.0:1786960782.701662:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:9950:x1873763958283008:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786960782.702464:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:9950:x1873763958283008:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 800us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960782.702480:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 256 00000100:00100000:3.0:1786960782.707967:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960782.708077:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283136 00000100:00100000:2.0:1786960782.708087:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283136 00000100:00100000:2.0:1786960782.708520:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 257 00000100:00100000:2.0:1786960782.708539:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:5583:x1873763958283136:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960782.708556:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960782.708572:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5f200/0x1808d16e4c97f73d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bec6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.708600:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5f200/0x1808d16e4c97f73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bec6 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.708611:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5f200/0x1808d16e4c97f73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bec6 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.708620:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f200, rc 0) 00000100:00100000:2.0:1786960782.708826:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958283136:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 295us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.708832:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 257 00000100:00100000:2.0:1786960782.710924:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960782.711036:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283264 00000100:00100000:3.0:1786960782.711044:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283264 00000100:00100000:3.0:1786960782.711092:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 258 00000100:00100000:3.0:1786960782.711102:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958283264:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.711828:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958283264:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 724us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.711836:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 258 00000100:00100000:0.0:1786960782.732074:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960782.732153:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283392 00000100:00100000:2.0:1786960782.732174:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283392 00000100:00100000:2.0:1786960782.732266:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 259 00000100:00100000:2.0:1786960782.732276:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958283392:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.732483:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:5583:x1873763958283392:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.732491:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 259 00000100:00100000:3.0:1786960782.741957:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960782.742332:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283520 00000100:00100000:2.0:1786960782.742342:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283520 00000100:00100000:2.0:1786960782.742619:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 260 00000100:00100000:2.0:1786960782.742630:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:9953:x1873763958283520:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960782.743530:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:9953:x1873763958283520:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 897us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.743539:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 260 00000100:00100000:3.0:1786960782.753435:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960782.753703:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283648 00000100:00100000:1.0:1786960782.753712:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283648 00000100:00100000:1.0:1786960782.753765:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 261 00000100:00100000:1.0:1786960782.753774:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:9953:x1873763958283648:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960782.753995:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:9953:x1873763958283648:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 222us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.754003:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 261 10000000:01000000:2.0:1786960782.772563:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960782.772570:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e6000 from 7 10000000:01000000:2.0:1786960782.772575:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960782.772619:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.772631:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.772643:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960782.772667:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967752832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.772731:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.772788:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960782.772934:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752832 00000100:00100000:0.0:1786960782.772941:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752832 00000100:00100000:0.0:1786960782.772992:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786960782.773000:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:5807:x1873763967752832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960782.773013:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960782.773026:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97666c6e1a00/0x1808d16e4c97f74b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f744 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.773049:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97666c6e1a00/0x1808d16e4c97f74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f744 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.773058:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97666c6e1a00/0x1808d16e4c97f74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f744 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.773068:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1a00, rc 0) 00000100:00100000:0.0:1786960782.773122:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967752832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960782.773128:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1786960782.773327:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967752832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960782.773340:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.773349:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960782.773397:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967752960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.773423:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.773454:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960782.773715:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967752960 00000100:00100000:1.0:1786960782.773720:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967752960 00000100:00100000:1.0:1786960782.773751:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1786960782.773758:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967752960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960782.773979:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967752960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.773994:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1786960782.774273:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967752960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.774304:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.774339:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.774364:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960782.775219:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753088 00000100:00100000:1.0:1786960782.775226:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753088 00000100:00100000:1.0:1786960782.775309:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1786960782.775327:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967753088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960782.775532:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967753088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960782.775540:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1786960782.775613:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.782900:0:11649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11649:1873763967753216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960782.782981:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.785160:0:11649:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960782.788049:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753216 00000100:00100000:0.0:1786960782.788063:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753216 00000100:00100000:0.0:1786960782.788784:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1786960782.788795:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:11649:x1873763967753216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960782.789053:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+17:11649:x1873763967753216:12345-0@lo:502:llog_process_th.0 Request processed in 261us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960782.789061:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1786960782.789691:0:11649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11649:1873763967753216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960782.789724:0:11649:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960782.789734:0:11649:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960782.789736:0:11649:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786960782.789742:0:11649:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9766772e6000 00000020:00000080:3.0:1786960782.789745:0:11649:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786960782.789829:0:11649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11649:1873763967753344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960782.789872:0:11649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960782.789906:0:11649:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.790367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753344 00000100:00100000:2.0:1786960782.790374:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753344 00000100:00100000:2.0:1786960782.790404:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1786960782.790413:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:11649:x1873763967753344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960782.790790:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:11649:x1873763967753344:12345-0@lo:502:llog_process_th.0 Request processed in 378us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.790797:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1786960782.792449:0:11649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11649:1873763967753344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960782.792677:0:11649:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960782.792684:0:11649:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960782.792687:0:11649:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786960782.792690:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786960782.795529:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1786960782.797610:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960782.797635:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.797652:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960782.797665:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960782.797668:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97667ad21800 from 7 10000000:01000000:2.0:1786960782.797672:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960782.797736:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.797745:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.797757:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960782.797939:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.798033:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.798438:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960782.798747:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753472 00000100:00100000:3.0:1786960782.798760:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753472 00000100:00100000:3.0:1786960782.798806:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1786960782.798816:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+17:5807:x1873763967753472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960782.798839:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960782.798855:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a800/0x1808d16e4c97f759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f752 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.798880:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a800/0x1808d16e4c97f759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f752 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.798891:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a800/0x1808d16e4c97f759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f752 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.798901:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a800, rc 0) 00000100:00100000:3.0:1786960782.798981:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967753472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960782.798988:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1786960782.799257:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960782.799274:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.799283:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960782.799355:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.799388:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.799417:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.799433:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753600 00000100:00100000:2.0:1786960782.799436:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753600 00000100:00100000:2.0:1786960782.799458:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1786960782.799476:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967753600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.801290:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967753600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1820us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.801300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1786960782.801449:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960782.801508:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960782.801556:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960782.801590:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646639000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.801817:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753728 00000100:00100000:2.0:1786960782.801823:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753728 00000100:00100000:2.0:1786960782.801860:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1786960782.801868:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967753728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.802006:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967753728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.802013:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1786960782.802107:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967753728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960782.806958:0:11652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11652:1873763967753856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960782.807045:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960782.807095:0:11652:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646639780 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.807642:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753856 00000100:00100000:2.0:1786960782.807651:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753856 00000100:00100000:2.0:1786960782.807703:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1786960782.807714:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:11652:x1873763967753856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960782.807939:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:11652:x1873763967753856:12345-0@lo:502:llog_process_th.0 Request processed in 228us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.807947:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1786960782.808083:0:11652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11652:1873763967753856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786960782.808111:0:11652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960782.808120:0:11652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960782.808122:0:11652:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786960782.808128:0:11652:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97667ad21800 00000020:00000080:0.0:1786960782.808130:0:11652:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786960782.808404:0:11652:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11652:1873763967753984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960782.808442:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960782.808474:0:11652:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646639780 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.808603:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967753984 00000100:00100000:2.0:1786960782.808608:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967753984 00000100:00100000:2.0:1786960782.808697:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1786960782.808705:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:11652:x1873763967753984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960782.808827:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:11652:x1873763967753984:12345-0@lo:502:llog_process_th.0 Request processed in 123us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.808834:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1786960782.809500:0:11652:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11652:1873763967753984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786960782.809527:0:11652:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960782.809532:0:11652:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960782.809534:0:11652:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786960782.809543:0:11652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1786960782.809678:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1786960782.809696:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786960782.809705:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.809716:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960782.809726:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786960782.809729:0:5807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff976652341800 from 7 10000000:01000000:0.0:1786960782.809732:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786960782.809755:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.809762:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960782.809771:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960782.809787:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786960782.809837:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960782.809864:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646639840 going to sleep for 11 seconds 00000100:00100000:3.0:1786960782.809989:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754112 00000100:00100000:3.0:1786960782.809995:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754112 00000100:00100000:3.0:1786960782.810025:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1786960782.810033:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+18:5807:x1873763967754112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960782.810044:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960782.810057:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a400/0x1808d16e4c97f767 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c97f760 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.810080:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a400/0x1808d16e4c97f767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c97f760 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.810090:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a400/0x1808d16e4c97f767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c97f760 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960782.810098:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a400, rc 0) 00000100:00100000:3.0:1786960782.810141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967754112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960782.810160:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1786960782.810278:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960782.810292:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.810302:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960782.810343:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.810368:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.810436:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960782.810484:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754240 00000100:00100000:3.0:1786960782.810489:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754240 00000100:00100000:3.0:1786960782.810546:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1786960782.810553:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967754240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960782.811838:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967754240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1281us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960782.811912:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000040:00080000:1.0:1786960782.812409:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1786960782.814026:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.814075:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.814128:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960782.814158:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665166f240 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.814948:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754368 00000100:00100000:2.0:1786960782.814955:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754368 00000100:00100000:2.0:1786960782.814993:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1786960782.815001:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967754368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960782.815162:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:5807:x1873763967754368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.815174:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1786960782.820381:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c3f21e71-ba64-41c6-8589-43a20e36767f:5807:1873763967754368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960782.821384:0:11655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11655:1873763967754496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960782.821463:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960782.821646:0:11655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96900 going to sleep for 11 seconds 00000100:00100000:0.0:1786960782.822135:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754496 00000100:00100000:0.0:1786960782.822143:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754496 00000100:00100000:0.0:1786960782.822226:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786960782.822236:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:11655:x1873763967754496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960782.822455:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:11655:x1873763967754496:12345-0@lo:502:llog_process_th.0 Request processed in 220us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960782.822472:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1786960782.823210:0:11655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11655:1873763967754496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960782.823239:0:11655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786960782.823248:0:11655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960782.823250:0:11655:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1786960782.823257:0:11655:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff976652341800 00000020:00000080:3.0:1786960782.823260:0:11655:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786960782.823346:0:11655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11655:1873763967754624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960782.823389:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960782.823414:0:11655:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96900 going to sleep for 11 seconds 00000100:00100000:2.0:1786960782.823484:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754624 00000100:00100000:2.0:1786960782.823490:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754624 00000100:00100000:2.0:1786960782.823522:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1786960782.823530:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:11655:x1873763967754624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960782.823838:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:11655:x1873763967754624:12345-0@lo:502:llog_process_th.0 Request processed in 308us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960782.823847:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1786960782.823928:0:11655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c3f21e71-ba64-41c6-8589-43a20e36767f:11655:1873763967754624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960782.823949:0:11655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960782.823953:0:11655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960782.823955:0:11655:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786960782.823963:0:11655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786960782.824369:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1786960782.824390:0:5807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960782.824400:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960782.824411:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960783.604394:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960783.860835:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786960784.628344:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786960784.800718:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1786960785.204414:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960785.204480:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960785.204543:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786960785.204550:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967755008:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.204577:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960785.204605:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755520:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.204627:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960785.204671:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755136 00000100:00100000:2.0:1786960785.204678:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755136 00000100:00100000:2.0:1786960785.204727:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786960785.204736:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960785.204769:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960785.204812:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.204820:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1786960785.204839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960785.204862:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1786960785.204866:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff976677b69c00, transno 4294967300 00000100:00100000:2.0:1786960785.204881:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960785.205393:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967754752:0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.205426:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960785.205458:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967755264:0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.205478:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960785.205497:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786960785.205503:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967754880:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205516:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754752 00000100:00100000:2.0:1786960785.205520:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754752 00000100:00100000:1.0:1786960785.205523:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960785.205537:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967755392:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205546:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1786960785.205552:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.205556:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960785.205579:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755008 00000100:00100000:1.0:1786960785.205583:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755008 00000100:00100000:2.0:1786960785.205596:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967754752:12345-0@lo:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.205602:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1786960785.205612:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967754880 00000100:00100000:1.0:1786960785.205615:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967754880 00000100:00100000:1.0:1786960785.205626:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755392 00000100:00100000:1.0:1786960785.205634:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755392 00000100:00100000:2.0:1786960785.205639:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786960785.205645:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967755008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.205650:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786960785.205667:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205678:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967755008:12345-0@lo:400:kworker.0 Request processed in 33us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.205684:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1786960785.205693:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967754880:12345-0@lo:400:kworker.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.205697:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786960785.205700:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1786960785.205702:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967755392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.205725:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967754880:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205735:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967755392:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960785.205735:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967755392:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205741:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786960785.205742:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967754752:0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.205757:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755520 00000100:00100000:2.0:1786960785.205761:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755520 00000100:00100000:2.0:1786960785.206128:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755264 00000100:00100000:2.0:1786960785.206133:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755264 00000100:00100000:2.0:1786960785.206168:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786960785.206202:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.206241:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755520:12345-0@lo:400:kworker.0 Request processed in 66us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.206247:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786960785.206258:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786960785.206264:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967755264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960785.206290:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967755264:12345-0@lo:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960785.206295:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1786960785.206308:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960785.206312:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960785.206328:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967755008:0@lo:400:kworker.0 00010000:00080000:2.0:1786960785.206340:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976677b6a300 x1873763967755520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960785.206349:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755520:0@lo:400:kworker.0 00000100:00100000:1.0:1786960785.207139:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967755264:0@lo:400:kworker.0 00010000:00010000:1.0:1786960785.652362:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960785.718624:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960785.718701:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960785.719087:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755648 00000100:00100000:0.0:1786960785.719097:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755648 00000100:00100000:0.0:1786960785.719149:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786960785.719159:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960785.719218:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960785.720051:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967755648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 889us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960785.720060:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1786960785.723827:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772fc000 x1873763967755648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960785.723857:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967755648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786960786.676350:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960787.608729:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960787.608786:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960787.608820:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960787.608846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960787.608924:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283904 00000100:00100000:2.0:1786960787.608949:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958283776 00000100:00100000:3.0:1786960787.608952:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283904 00000100:00100000:2.0:1786960787.608962:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958283776 00000100:00100000:2.0:1786960787.609033:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 278 00000100:00100000:2.0:1786960787.609045:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958283776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960787.609051:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284160 00000100:00100000:3.0:1786960787.609058:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284160 00000100:00100000:3.0:1786960787.609097:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1786960787.609109:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958283904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960787.609118:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958283776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960787.609128:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 278 00000100:00100000:2.0:1786960787.609228:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1786960787.609240:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958284160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960787.609251:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958283904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 142us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960787.609261:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:2.0:1786960787.609313:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958284160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 74us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960787.609322:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00080000:0.0:1786960787.610096:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960787.610177:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284032 00000100:00100000:1.0:1786960787.610218:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284032 00000100:00080000:0.0:1786960787.610436:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960787.610650:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960787.610660:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958284032:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960787.610728:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958284032:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 70us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960787.610744:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00010000:00010000:1.0:1786960787.700494:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960788.724382:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960789.748943:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960790.324459:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756160:0@lo:400:kworker.0 00000100:00100000:2.0:1786960790.324529:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960790.324593:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960790.324599:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967756032:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.324863:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967755776:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.324901:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960790.324928:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967756288:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.324956:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960790.325007:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786960790.325015:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967755904:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325040:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960790.325059:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967756416:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325081:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960790.325115:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756288 00000100:00100000:1.0:1786960790.325122:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756288 00000100:00100000:1.0:1786960790.325207:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755904 00000100:00100000:1.0:1786960790.325211:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755904 00000100:00100000:1.0:1786960790.325237:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1786960790.325247:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967756288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325299:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967756288:12345-0@lo:400:kworker.0 Request processed in 53us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.325306:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1786960790.325322:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1786960790.325328:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667acadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967755904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325357:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667acadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967755904:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.325363:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1786960790.325393:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756160 00000100:00100000:1.0:1786960790.325397:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756160 00000100:00100000:1.0:1786960790.325422:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756416 00000100:00100000:1.0:1786960790.325425:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756416 00000100:00100000:1.0:1786960790.325445:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960790.325452:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325483:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756160:12345-0@lo:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.325489:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960790.325508:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786960790.325515:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967756416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325545:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967756416:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.325551:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1786960790.325566:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960790.325571:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960790.325573:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960790.325627:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967755904:0@lo:400:kworker.0 00010000:00080000:1.0:1786960790.325642:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff976677b6a300 x1873763967756416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960790.325653:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967756416:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325663:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967756288:0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325703:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967755776 00000100:00100000:1.0:1786960790.325706:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967755776 00000100:00100000:1.0:1786960790.325732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786960790.325738:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967755776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.325772:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967755776:12345-0@lo:400:kworker.0 Request processed in 34us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.325779:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786960790.325813:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967755776:0@lo:400:kworker.0 00000100:00100000:2.0:1786960790.326236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960790.326262:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756160:0@lo:400:kworker.0 00000100:00100000:2.0:1786960790.326270:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960790.326279:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960790.326312:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960790.327584:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756544 00000100:00100000:1.0:1786960790.327594:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756544 00000100:00100000:1.0:1786960790.327659:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960790.327668:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960790.327714:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960790.327780:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.327787:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786960790.327813:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756032 00000100:00100000:1.0:1786960790.327817:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756032 00000100:00100000:1.0:1786960790.327863:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1786960790.327870:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967756032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960790.327905:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967756032:12345-0@lo:400:kworker.0 Request processed in 36us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960790.327911:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1786960790.328069:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960790.335678:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960790.335697:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967756032:0@lo:400:kworker.0 00010000:00010000:2.0:1786960790.772370:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960790.836707:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960790.836773:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960790.837047:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756672 00000100:00100000:3.0:1786960790.837055:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756672 00000100:00100000:3.0:1786960790.837111:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1786960790.837121:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960790.837167:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960790.837330:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967756672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960790.837337:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1786960790.839564:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772fce00 x1873763967756672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960790.839591:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967756672:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960791.796538:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960792.733810:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960792.733861:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960792.733918:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960792.733961:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960792.733996:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284544 00000100:00100000:0.0:1786960792.734005:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284544 00000100:00100000:0.0:1786960792.734069:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:0.0:1786960792.734080:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284544:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960792.734163:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284544:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960792.734170:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1786960792.734410:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284288 00000100:00100000:3.0:1786960792.734415:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284288 00000100:00100000:3.0:1786960792.734523:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 280 00000100:00100000:3.0:1786960792.734530:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958284288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960792.734563:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958284288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960792.734570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 280 00000100:00080000:3.0:1786960792.734598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960792.734781:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284416 00000100:00100000:2.0:1786960792.734786:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284416 00000100:00100000:2.0:1786960792.734829:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284672 00000100:00100000:2.0:1786960792.734832:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284672 00000100:00100000:2.0:1786960792.734854:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1786960792.734862:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284416:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960792.734910:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284416:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960792.734918:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1786960792.734931:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:2.0:1786960792.734937:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958284672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960792.734961:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958284672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960792.734967:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00080000:3.0:1786960792.735107:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786960792.820288:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960793.076754:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786960793.846791:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960794.868432:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960795.444604:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967757184:0@lo:400:kworker.0 00000100:00100000:3.0:1786960795.444668:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960795.444730:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960795.444736:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967757056:0@lo:400:kworker.0 00000100:00100000:3.0:1786960795.444759:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960795.444800:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757184 00000100:00100000:3.0:1786960795.444806:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757184 00000100:00100000:3.0:1786960795.444857:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786960795.444865:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960795.444909:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967757184:12345-0@lo:400:kworker.0 Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960795.444917:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1786960795.444938:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960795.444968:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967757184:0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.445243:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967757568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960795.445270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960795.445459:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967756928:0@lo:400:kworker.0 00000100:00100000:2.0:1786960795.445487:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960795.445533:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967757440:0@lo:400:kworker.0 00000100:00100000:2.0:1786960795.445554:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960795.445570:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1786960795.445574:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967756800:0@lo:400:kworker.0 00000100:00100000:2.0:1786960795.445598:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960795.445620:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967757312:0@lo:400:kworker.0 00000100:00100000:2.0:1786960795.445639:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960795.445670:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757568 00000100:00100000:2.0:1786960795.445674:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757568 00000100:00100000:2.0:1786960795.445704:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786960795.445711:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967757568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960795.445739:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960795.445772:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967757568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960795.445778:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786960795.445934:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757056 00000100:00100000:0.0:1786960795.445939:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757056 00000100:00100000:0.0:1786960795.445973:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756928 00000100:00100000:0.0:1786960795.445976:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756928 00000100:00100000:0.0:1786960795.445989:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757312 00000100:00100000:0.0:1786960795.446002:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757312 00000100:00100000:0.0:1786960795.446019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1786960795.446026:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967757056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446058:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967757056:12345-0@lo:400:kworker.0 Request processed in 33us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960795.446064:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1786960795.446077:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1786960795.446082:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967756928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446125:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967756928:12345-0@lo:400:kworker.0 Request processed in 43us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960795.446130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1786960795.446142:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786960795.446147:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446173:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967757312:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960795.446177:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1786960795.446215:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960795.446245:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967757568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960795.446265:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757440 00000100:00100000:0.0:1786960795.446268:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757440 00000100:00100000:0.0:1786960795.446305:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786960795.446311:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967757440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446350:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967757440:12345-0@lo:400:kworker.0 Request processed in 40us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960795.446356:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1786960795.446371:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960795.446397:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967756800 00000100:00100000:0.0:1786960795.446401:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967756800 00000100:00100000:0.0:1786960795.446423:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786960795.446430:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967756800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446458:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967756800:12345-0@lo:400:kworker.0 Request processed in 29us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960795.446464:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1786960795.446531:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967756800:0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446543:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967757312:0@lo:400:kworker.0 00000100:00100000:0.0:1786960795.446552:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967756928:0@lo:400:kworker.0 00010000:00080000:0.0:1786960795.446563:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772ff100 x1873763967757440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960795.446572:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967757440:0@lo:400:kworker.0 00000100:00100000:3.0:1786960795.447018:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967757056:0@lo:400:kworker.0 00010000:00010000:1.0:1786960795.896653:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960795.956658:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960795.956682:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967757696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960795.956748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960795.956864:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757696 00000100:00100000:3.0:1786960795.956873:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757696 00000100:00100000:3.0:1786960795.956917:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786960795.956926:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967757696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960795.956961:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960795.957014:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967757696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960795.957022:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1786960795.957097:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772fea00 x1873763967757696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960795.957125:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967757696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786960796.918729:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960797.850771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960797.850820:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960797.850909:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284800 00000100:00100000:1.0:1786960797.850932:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284800 00000100:00100000:1.0:1786960797.850983:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 282 00000100:00100000:1.0:1786960797.850993:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958284800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960797.851078:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958284800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960797.851085:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 282 00000100:00100000:2.0:1786960797.851985:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958284928 00000100:00100000:2.0:1786960797.851993:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958284928 00000100:00100000:2.0:1786960797.852057:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:2.0:1786960797.852066:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960797.852133:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958284928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960797.852148:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00080000:0.0:1786960797.852374:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960797.861987:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960797.862043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960797.862141:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285056 00000100:00100000:3.0:1786960797.862158:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285056 00000100:00100000:2.0:1786960797.862349:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285184 00000100:00100000:2.0:1786960797.862361:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285184 00000100:00100000:3.0:1786960797.862368:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1786960797.862405:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2340:x1873763958285056:12345-192.168.203.23@tcp:9:kworker.0 00000100:00100000:2.0:1786960797.862430:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:2.0:1786960797.862443:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958285184:12345-192.168.203.23@tcp:400:kworker.0 00000020:00000080:3.0:1786960797.862448:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f6a3 00000100:00080000:3.0:1786960797.862464:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667b0bb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960797.862528:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1786960797.862554:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958285184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 113us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960797.862564:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00080000:0.0:1786960797.862907:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960797.862922:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786960797.862968:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960797.864174:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+2:2340:x1873763958285056:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 1766us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960797.864205:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:2.0:1786960797.940365:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960798.964508:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960799.988636:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960800.105497:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:1.0:1786960800.105509:0:6685:0:(genops.c:906:class_export_put()) final put ffff97667b0bc000/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:3.0:1786960800.105602:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b0bc000/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-OST0000 00000020:00000080:3.0:1786960800.105864:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667b0bb000 for lustre-OST0000 00000100:00100000:2.0:1786960800.564605:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967757824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960800.564721:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960800.564771:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757824 00000100:00100000:1.0:1786960800.564783:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757824 00000100:00100000:2.0:1786960800.565157:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960800.565169:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967757952:0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.565225:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960800.565272:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967757952 00000100:00100000:2.0:1786960800.565277:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967757952 00000100:00100000:2.0:1786960800.565327:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1786960800.565337:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967757952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.565399:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967757952:12345-0@lo:400:kworker.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960800.565407:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1786960800.565461:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967757952:0@lo:400:kworker.0 00000100:00100000:1.0:1786960800.566211:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960800.566226:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967757824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960800.566267:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960800.566385:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967757824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960800.566391:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960800.566423:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967758080:0@lo:400:kworker.0 00000100:00100000:1.0:1786960800.566458:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786960800.566517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960800.574482:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960800.574511:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967758208:0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.574603:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960800.574657:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758080 00000100:00100000:3.0:1786960800.574667:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758080 00000100:00100000:3.0:1786960800.574717:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758208 00000100:00100000:3.0:1786960800.574721:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758208 00000100:00100000:3.0:1786960800.574760:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1786960800.574770:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967758080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.574836:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967758080:12345-0@lo:400:kworker.0 Request processed in 67us (8377us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960800.574844:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1786960800.574863:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1786960800.574869:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967758208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.574895:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967758208:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960800.574901:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1786960800.574946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960800.574982:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967758208:0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.574997:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967758080:0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.577377:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967758336:0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.577474:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960800.577559:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967757824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960800.577594:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960800.577601:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967758464:0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.577629:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960800.577683:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758464 00000100:00100000:2.0:1786960800.577690:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758464 00000100:00100000:2.0:1786960800.577745:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1786960800.577752:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967758464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960800.577807:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967758464:12345-0@lo:400:kworker.0 Request processed in 54us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960800.577814:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1786960800.577851:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772fdf80 x1873763967758464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960800.577865:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967758464:0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.578485:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758336 00000100:00100000:3.0:1786960800.578493:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758336 00000100:00100000:3.0:1786960800.578563:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1786960800.578572:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967758336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960800.578634:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967758336:12345-0@lo:400:kworker.0 Request processed in 63us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960800.578641:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1786960800.578668:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786960800.578673:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960800.581289:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967758336:0@lo:400:kworker.0 00010000:00010000:0.0:1786960801.013821:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960801.076594:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960801.076627:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967758592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960801.076726:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960801.078653:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758592 00000100:00100000:3.0:1786960801.078670:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758592 00000100:00100000:3.0:1786960801.078770:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786960801.078783:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967758592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960801.078821:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960801.078904:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967758592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960801.078911:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1786960801.078988:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772ff800 x1873763967758592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960801.079021:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967758592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786960802.036323:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960802.971287:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960802.971319:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960802.971340:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960802.971365:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285440 00000100:00100000:2.0:1786960802.971373:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285440 00000100:00100000:2.0:1786960802.971424:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285568 00000100:00100000:2.0:1786960802.971427:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285568 00000100:00100000:2.0:1786960802.971449:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1786960802.971458:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958285440:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960802.971526:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958285440:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 68us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960802.971543:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1786960802.971559:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:2.0:1786960802.971565:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958285568:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960802.974463:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958285568:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2887us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960802.974478:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:0.0:1786960802.974782:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285312 00000100:00100000:0.0:1786960802.974792:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285312 00000100:00100000:0.0:1786960802.974837:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 284 00000100:00100000:0.0:1786960802.974846:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958285312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960802.974889:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958285312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (3568us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960802.974895:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 284 00000100:00080000:3.0:1786960802.977388:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786960803.060360:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960803.318521:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786960804.085814:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960805.110562:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960805.155966:0:11818:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:00:04 (1786960804) 00000100:00100000:1.0:1786960805.684497:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960805.684520:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967759104:0@lo:400:kworker.0 00000100:00100000:0.0:1786960805.684550:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967758976:0@lo:400:kworker.0 00000100:00100000:0.0:1786960805.684582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960805.684607:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758976 00000100:00100000:1.0:1786960805.684614:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758976 00000100:00100000:2.0:1786960805.684675:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976648d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967759232:0@lo:400:kworker.0 00000100:00100000:2.0:1786960805.684706:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960805.684880:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967759488:0@lo:400:kworker.0 00000100:00100000:0.0:1786960805.684906:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960805.686007:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967758848:0@lo:400:kworker.0 00000100:00100000:3.0:1786960805.686068:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960805.689432:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1786960805.689466:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967758976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960805.689548:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967758976:12345-0@lo:400:kworker.0 Request processed in 89us (4964us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960805.689555:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1786960805.689605:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960805.690277:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967759232 00000100:00100000:2.0:1786960805.690286:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967759232 00000100:00100000:2.0:1786960805.690334:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967759488 00000100:00100000:2.0:1786960805.690337:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967759488 00000100:00100000:2.0:1786960805.690359:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960805.690368:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967759232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960805.690420:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967759232:12345-0@lo:400:kworker.0 Request processed in 54us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960805.690426:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960805.690439:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786960805.690453:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967759488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960805.690482:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967759488:12345-0@lo:400:kworker.0 Request processed in 37us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960805.690488:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786960805.690505:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758848 00000100:00100000:2.0:1786960805.690508:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758848 00000100:00100000:2.0:1786960805.690541:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1786960805.690546:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967758848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960805.690575:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967758848:12345-0@lo:400:kworker.0 Request processed in 30us (4507us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960805.690580:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1786960805.690604:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967759104 00000100:00100000:2.0:1786960805.690607:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967759104 00000100:00100000:2.0:1786960805.690627:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1786960805.690800:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766597a5f80 x1873763967759488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786960821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960805.690814:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967759488:0@lo:400:kworker.0 00000100:00100000:0.0:1786960805.690843:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967758976:0@lo:400:kworker.0 00000100:00080000:0.0:1786960805.690932:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960805.690936:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786960805.690938:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960805.691054:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967759104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960805.691090:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967759104:12345-0@lo:400:kworker.0 Request processed in 457us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960805.691097:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786960805.691137:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967759232:0@lo:400:kworker.0 00000100:00100000:3.0:1786960805.696522:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967758848:0@lo:400:kworker.0 00000100:00100000:3.0:1786960805.696559:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967759360:0@lo:400:kworker.0 00000100:00100000:3.0:1786960805.696619:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960805.696743:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967759360 00000100:00100000:0.0:1786960805.696751:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967759360 00000100:00100000:0.0:1786960805.696815:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1786960805.696825:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960805.696877:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967759360:12345-0@lo:400:kworker.0 Request processed in 54us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960805.696885:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1786960805.696934:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967759360:0@lo:400:kworker.0 00000100:00080000:3.0:1786960805.697394:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960805.703415:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976648d7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967759104:0@lo:400:kworker.0 00000100:00100000:1.0:1786960805.703430:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960805.703493:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960805.703772:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967758720 00000100:00100000:3.0:1786960805.703780:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967758720 00000100:00100000:3.0:1786960805.703836:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786960805.703846:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960805.703882:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960805.703941:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960805.703949:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786960805.704131:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967758720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786960806.135222:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960806.196622:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960806.196695:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960806.201051:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967759616 00000100:00100000:2.0:1786960806.201068:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967759616 00000100:00100000:2.0:1786960806.201146:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786960806.201157:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967759616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960806.201228:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960806.202490:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967759616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1328us (5789us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960806.202501:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1786960806.205432:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766772fea00 x1873763967759616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960806.205458:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960806.638024:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960806.638149:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285696 00000100:00100000:3.0:1786960806.638159:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285696 00000100:00100000:3.0:1786960806.638266:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1786960806.638278:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:10223:x1873763958285696:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960806.638296:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960806.638319:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f76e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790becd expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638383:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638398:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638410:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960806.638617:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786960806.638621:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960806.638718:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638745:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f76e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790becd expref: 7 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638764:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790becd expref: 6 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.638773:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960806.638776:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960806.638779:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b600, rc 0) 00000100:00100000:3.0:1786960806.638844:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:10223:x1873763958285696:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 569us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960806.638852:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00080000:0.0:1786960806.638911:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960806.647353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960806.650143:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958285824 00000100:00100000:0.0:1786960806.650157:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958285824 00000100:00100000:0.0:1786960806.650271:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1786960806.650281:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:10224:x1873763958285824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960806.650301:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960806.650324:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f77c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bed4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650388:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650402:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650425:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650440:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650447:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650453:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650822:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650832:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.650839:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960806.650917:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786960806.650921:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960806.650993:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651004:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651011:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651026:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651045:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960806.651049:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651057:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651070:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976643e01a00) 00010000:00010000:0.0:1786960806.651073:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960806.651077:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651083:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651094:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651100:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651106:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651111:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960806.651114:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651130:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651139:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9766559de100) 00010000:00010000:0.0:1786960806.651141:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960806.651143:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651148:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f78a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651179:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f77c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bed4 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651245:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bed4 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960806.651252:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766559de900) 00010000:00010000:0.0:1786960806.651255:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960806.651257:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0e00, rc 0) 00000100:00100000:0.0:1786960806.651332:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:10224:x1873763958285824:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1052us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960806.651340:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:2.0:1786960806.656456:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960806.656549:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286080 00000100:00100000:3.0:1786960806.656560:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286080 00000100:00100000:3.0:1786960806.656620:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1786960806.656630:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:10224:x1873763958286080:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960806.656650:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960806.656671:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f798 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bedb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656747:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656775:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656787:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656803:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656810:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.656816:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657374:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c97f7ad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657384:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c97f7ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657391:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c97f7ad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960806.657401:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786960806.657611:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657620:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657626:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657639:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960806.657644:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657651:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657663:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766559de900) 00010000:00010000:3.0:1786960806.657666:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960806.657671:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657677:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f79f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657690:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657695:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657700:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657704:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960806.657707:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657712:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657731:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff976643e01e00) 00010000:00010000:3.0:1786960806.657733:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960806.657736:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.657743:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f7a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.658138:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f798 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bedb expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.658155:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c97f7ad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bedb expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960806.658163:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:3.0:1786960806.658166:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960806.658168:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a600, rc 0) 00000100:00100000:3.0:1786960806.658257:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10224:x1873763958286080:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1628us (1811us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1786960806.658265:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:3.0:1786960806.664309:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960806.664441:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286208 00000100:00100000:0.0:1786960806.664452:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286208 00000100:00100000:0.0:1786960806.664514:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1786960806.664525:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10224:x1873763958286208:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786960806.664648:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10224:x1873763958286208:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960806.664656:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00010000:00010000:3.0:1786960807.156381:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960807.414486:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1786960808.089238:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960808.089323:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960808.089631:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286464 00000100:00100000:3.0:1786960808.089641:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286464 00000100:00100000:3.0:1786960808.089704:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:3.0:1786960808.089714:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958286464:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:2.0:1786960808.089825:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960808.090295:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958286464:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 580us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960808.090316:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1786960808.093180:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286336 00000100:00100000:2.0:1786960808.093317:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960808.093380:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286592 00000100:00100000:0.0:1786960808.093389:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286592 00000100:00100000:0.0:1786960808.093453:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:0.0:1786960808.093462:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958286592:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960808.093530:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958286592:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960808.093537:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:1.0:1786960808.093877:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286336 00000100:00100000:1.0:1786960808.093909:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 286 00000100:00100000:1.0:1786960808.093916:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958286336:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960808.093950:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958286336:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (4626us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960808.093956:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 286 00000100:00080000:2.0:1786960808.094060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786960808.182348:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960808.940542:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960808.940707:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286720 00000100:00100000:0.0:1786960808.940716:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286720 00000100:00100000:0.0:1786960808.940780:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1786960808.940791:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10267:x1873763958286720:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960808.940811:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960808.940842:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f7bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bee2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940907:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940921:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940932:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940960:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940968:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.940975:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941231:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941240:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941256:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941263:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960808.941268:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941275:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941287:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976643e01a00) 00010000:00010000:0.0:1786960808.941291:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960808.941295:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941302:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f7c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941320:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941326:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941331:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941337:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960808.941340:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941346:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941354:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766559de000) 00010000:00010000:0.0:1786960808.941357:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960808.941359:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941364:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f7c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941395:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f7bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bee2 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941405:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976643e01a00) 00010000:00010000:0.0:1786960808.941407:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960808.941417:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f7bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bee2 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.941426:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1000, rc 0) 00000100:00100000:0.0:1786960808.941482:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10267:x1873763958286720:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 693us (948us total) trans 0 rc 301/301 00000100:00100000:0.0:1786960808.941489:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1786960808.954287:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960808.955599:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958286976 00000100:00100000:0.0:1786960808.955611:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958286976 00000100:00100000:0.0:1786960808.955670:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1786960808.955680:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10267:x1873763958286976:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:0.0:1786960808.955734:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960808.955770:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f775 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790becd expref: 9 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.955792:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976643e01a00) 00010000:00010000:0.0:1786960808.955803:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960808.956067:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956080:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956088:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956099:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956105:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956117:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960808.956972:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786960808.956984:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956992:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.956998:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.957004:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960808.957009:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.957030:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.957042:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960808.957045:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960808.957049:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960808.957055:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f7d0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960808.957071:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005eda8bef reply state 00000000c27401e8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960808.957091:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960808.957216:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:10267:x1873763958286976:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 1535us (2936us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1786960808.957224:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00010000:00010000:2.0:1786960808.960955:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.960972:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.960980:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.960986:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960808.960991:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.960998:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.961015:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9766559de500) 00010000:00010000:2.0:1786960808.961028:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960808.961033:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960808.961040:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f7d7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.029990:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.030132:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287104 00000100:00100000:0.0:1786960809.030153:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287104 00000100:00100000:0.0:1786960809.030233:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1786960809.030243:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:10275:x1873763958287104:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:0.0:1786960809.030270:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960809.030292:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f7de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bee9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030365:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030378:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030390:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960809.030448:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786960809.030453:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960809.030493:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030519:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f7de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bee9 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030559:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bee9 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.030568:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960809.030571:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960809.030575:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169200, rc 0) 00000100:00100000:0.0:1786960809.030643:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:10275:x1873763958287104:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 401us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960809.030649:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:1.0:1786960809.066080:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.070287:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287232 00000100:00100000:2.0:1786960809.070303:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287232 00000100:00100000:1.0:1786960809.084234:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1786960809.084248:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:10281:x1873763958287232:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960809.084268:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.084289:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bef0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084367:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084392:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084403:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084418:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084426:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084432:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084535:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084544:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084551:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960809.084597:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1786960809.084601:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960809.084642:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084655:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084671:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084678:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084685:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960809.084689:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084697:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084710:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:1.0:1786960809.084713:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960809.084718:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084724:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f7f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084737:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084743:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084749:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084754:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960809.084763:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084770:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084779:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff976661496a00) 00010000:00010000:1.0:1786960809.084782:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960809.084785:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084791:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97f7fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084822:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97f7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef0 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084835:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef0 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.084842:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960809.084845:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786960809.084847:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93c00, rc 0) 00000100:00100000:1.0:1786960809.084910:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:10281:x1873763958287232:12345-192.168.203.23@tcp:101:bash.0 Request processed in 665us (18838us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960809.084918:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1786960809.092665:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.092798:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287488 00000100:00100000:1.0:1786960809.092808:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287488 00000100:00100000:1.0:1786960809.092866:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:1.0:1786960809.092877:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:10281:x1873763958287488:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960809.092906:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.092925:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97f808 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bef7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093075:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093089:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093100:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093114:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093120:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093126:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786960809.093798:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786960809.093958:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093967:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.093976:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094031:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094038:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094045:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094050:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960809.094054:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094061:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094072:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960809.094075:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960809.094079:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094084:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f80f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960809.094096:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c03253d7 reply state 00000000cc7a540b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960809.094104:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786960809.094133:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97f808 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094159:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.094166:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960809.094169:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960809.094171:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92a00, rc 0) 00000100:00100000:1.0:1786960809.094257:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10281:x1873763958287488:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1382us (1602us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1786960809.094264:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00010000:00010000:3.0:1786960809.103707:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103726:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103734:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103740:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960809.103745:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103752:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103768:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976661496900) 00010000:00010000:3.0:1786960809.103771:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960809.103775:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.103781:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f816 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960809.109446:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.109690:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287616 00000100:00100000:2.0:1786960809.109701:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287616 00000100:00100000:2.0:1786960809.109747:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1786960809.109768:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1873763958287616:12345-192.168.203.23@tcp:8:bash.0 00010000:00080000:2.0:1786960809.109798:0:6659:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:2.0:1786960809.109828:0:6659:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97f82b 00002000:00100000:2.0:1786960809.109840:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e2d64e27-0ccc-4195-8812-2a972b8bf63c/ffff9766818d6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786960809.109862:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786960809.110084:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786960809.110117:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9766818d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960809.110268:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958287616:12345-192.168.203.23@tcp:8:bash.0 Request processed in 499us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960809.110275:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1786960809.122642:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.122716:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287744 00000100:00100000:1.0:1786960809.122726:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287744 00000100:00100000:1.0:1786960809.122799:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1786960809.122809:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:0:x1873763958287744:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960809.122828:0:8239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.122850:0:8239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790befe expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960809.122879:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960809.122899:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=291s v=(0 0) 00010000:00010000:1.0:1786960809.122903:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960809.122914:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.122934:0:8239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.122965:0:8239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93a00, rc 0) 00000100:00100000:1.0:1786960809.123030:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:0:x1873763958287744:12345-192.168.203.23@tcp:101:bash.0 Request processed in 212us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960809.123037:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00080000:0.0:1786960809.123436:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960809.139218:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.139622:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958287872 00000100:00100000:2.0:1786960809.139632:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958287872 00000100:00100000:2.0:1786960809.139681:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1786960809.139690:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:10281:x1873763958287872:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960809.139706:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960809.139725:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf05 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.139753:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 8 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.139763:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960809.139767:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960809.139772:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.139817:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 8 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.139830:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 8 pid: 8239 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.139844:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967759744:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960809.139921:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646bb1000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960809.160572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.160605:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958288000 00000100:00100000:2.0:1786960809.160613:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958288000 00010000:00010000:2.0:1786960809.160661:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 9 pid: 8239 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.160698:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:2.0:1786960809.160707:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958288000:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960809.160722:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960809.160742:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 9 pid: 8239 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.160756:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 9 pid: 8239 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.160781:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960809.160794:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960809.160803:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.160814:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.160848:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.160864:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967759872:192.168.203.23@tcp:105: 00000100:00100000:2.0:1786960809.160934:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646bb1e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786960809.161656:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c97f832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790befe expref: 9 pid: 8239 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960809.161675:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f02680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967759744:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960809.161700:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.161711:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e400, rc 0) 00000100:00100000:0.0:1786960809.161753:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:10281:x1873763958287872:12345-192.168.203.23@tcp:101:bash.0 Request processed in 22063us (22540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960809.161761:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1786960809.165953:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967759872:192.168.203.23@tcp:105: 00010000:00010000:3.0:1786960809.165978:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960809.166047:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958288000:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 5340us (5485us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960809.166058:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:2.0:1786960809.183406:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.183912:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958288256 00000100:00100000:0.0:1786960809.183930:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958288256 00000100:00100000:0.0:1786960809.184014:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1786960809.184033:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10281:x1873763958288256:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:0.0:1786960809.184455:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10281:x1873763958288256:12345-192.168.203.23@tcp:35:bash.0 Request processed in 422us (1055us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1786960809.184463:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00010000:00010000:3.0:1786960809.206490:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960809.282811:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.283010:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958288512 00000100:00100000:1.0:1786960809.283027:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958288512 00000100:00100000:1.0:1786960809.283084:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1786960809.283094:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10291:x1873763958288512:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960809.283116:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.283137:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf0c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960809.283293:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786960809.283406:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f840 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf0c expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.283421:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:1.0:1786960809.283424:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786960809.283429:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf0c expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.283442:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92200, rc 0) 00000100:00100000:1.0:1786960809.283493:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10291:x1873763958288512:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 401us (690us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1786960809.283500:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:0.0:1786960809.292350:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.292453:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958288768 00000100:00100000:2.0:1786960809.292463:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958288768 00000100:00100000:2.0:1786960809.292518:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960809.292527:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10291:x1873763958288768:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960809.292797:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:10291:x1873763958288768:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 270us (456us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1786960809.292805:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1786960809.366501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.366718:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958288896 00000100:00100000:1.0:1786960809.366728:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958288896 00000100:00100000:1.0:1786960809.366783:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:1.0:1786960809.366793:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:10297:x1873763958288896:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960809.366816:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.366839:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f84e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf13 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.366902:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.366914:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.366924:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960809.366983:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1786960809.366986:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960809.367007:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.367040:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f84e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf13 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.367058:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf13 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.367066:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960809.367068:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960809.367081:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92800, rc 0) 00000100:00100000:1.0:1786960809.367135:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10297:x1873763958288896:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 344us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960809.367142:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1786960809.372541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.372651:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289152 00000100:00100000:1.0:1786960809.372660:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289152 00000100:00100000:1.0:1786960809.372711:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1786960809.372721:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10297:x1873763958289152:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960809.372739:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.372759:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f85c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf1a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.372853:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97f863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.372866:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97f863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.372877:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97f863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960809.372887:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786960809.373011:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c97f85c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf1a expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.373039:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97f863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf1a expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.373047:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960809.373063:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960809.373066:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93400, rc 0) 00000100:00100000:1.0:1786960809.373126:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10297:x1873763958289152:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 406us (594us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1786960809.373133:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1786960809.377654:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.377683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960809.377738:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289536 00000100:00100000:3.0:1786960809.377746:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289536 00000100:00100000:3.0:1786960809.377802:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1786960809.377811:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:2344:x1873763958289536:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960809.377825:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960809.377847:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97f863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf1a expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.377865:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:3.0:1786960809.377869:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960809.377920:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958289536:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 110us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960809.377927:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:1.0:1786960809.378320:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289408 00000100:00100000:1.0:1786960809.378324:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289408 00000100:00100000:1.0:1786960809.378356:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:1.0:1786960809.378363:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10297:x1873763958289408:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960809.378380:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960809.378393:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97f871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf21 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.378470:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.378481:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.378490:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960809.378502:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786960809.378604:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97f871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf21 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.378616:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf21 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.378639:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960809.378641:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786960809.378643:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93a00, rc 0) 00000100:00100000:1.0:1786960809.378677:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10297:x1873763958289408:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 315us (1031us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1786960809.378682:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1786960809.387781:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.388112:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289664 00000100:00100000:1.0:1786960809.388121:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289664 00000100:00100000:1.0:1786960809.388174:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1786960809.388183:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958289664:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:1.0:1786960809.388240:0:8239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.388266:0:8239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.388274:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960809.388278:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960809.388282:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.388456:0:8239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.388469:0:8239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 7 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960809.388494:0:8239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8239:1873763967760000:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960809.388623:0:8239:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5610c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960809.391957:0:8239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8239:1873763967760000:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960809.391986:0:8239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960809.395239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960809.395831:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289792 00000100:00100000:3.0:1786960809.395841:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289792 00002000:00100000:3.0:1786960809.395887:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9766597a4700 x1873763958289792/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:395/0 lens 504/0 e 0 to 0 dl 1786960820 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960809.395897:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766597a4700 with x1873763958289792 ext(0->12) 00010000:00010000:3.0:1786960809.395906:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 8 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.395940:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 8 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960809.395947:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9766597a4700 00000100:00100000:3.0:1786960809.395970:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960809.395979:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958289792:12345-192.168.203.23@tcp:4:lfs.0 00000001:00100000:1.0:1786960809.427158:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000100:00100000:3.0:1786960809.431114:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958289792:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 35126us (35875us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1786960809.431127:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:3.0:1786960809.431139:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9766597a4700 x1873763958289792/t4294967299(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:395/0 lens 504/448 e 0 to 0 dl 1786960820 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960809.431149:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766597a4700 with x1873763958289792 ext(0->12) 00010000:00010000:3.0:1786960809.431159:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.431179:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960809.433937:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9766597a4700 00000100:00100000:0.0:1786960809.435603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.435718:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958289920 00000100:00100000:2.0:1786960809.435727:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958289920 00010000:00010000:2.0:1786960809.435774:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.435810:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1786960809.435819:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958289920:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960809.435844:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786960809.435861:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1786960809.435864:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786960809 00002000:00010000:2.0:1786960809.435866:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786960809 00002000:00010000:2.0:1786960809.435868:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786960809 00010000:00010000:2.0:1786960809.435874:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.435886:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.435905:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005637efd3/0x1808d16e4c97f839 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf05 expref: 9 pid: 6659 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.435921:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786960809.435924:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786960809.435930:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.435938:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.435968:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960809.436135:0:8239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436145:0:8239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436168:0:8239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436176:0:8239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436205:0:8239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436212:0:8239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960809.436215:0:8239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436231:0:8239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436254:0:8239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.436262:0:8239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97f886 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.437004:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958289920:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1183us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960809.437056:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958289664:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 48874us (49282us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960809.437065:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1786960809.437105:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:0.0:1786960809.441041:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.441100:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958290176 00000100:00100000:2.0:1786960809.441108:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958290176 00000100:00100000:2.0:1786960809.441161:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960809.441171:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10297:x1873763958290176:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:2.0:1786960809.441265:0:5813:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf21 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960809.441834:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1786960809.441879:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1786960809.442896:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1786960809.442959:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.442976:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.442984:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.443031:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.443046:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 24 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.443059:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5813:1873763967760128:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960809.443230:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766472f6540 going to sleep for 11 seconds 00000100:00100000:0.0:1786960809.447936:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960809.448003:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958290304 00000100:00100000:3.0:1786960809.448012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958290304 00010000:00010000:3.0:1786960809.448091:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 25 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960809.448146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1786960809.448156:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:2344:x1873763958290304:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960809.448170:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960809.448177:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 25 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.448221:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 25 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.448248:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:3.0:1786960809.448253:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.448262:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.448268:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960809.448285:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960809.448491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:2344:x1873763958290304:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 335us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960809.448499:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00010000:00010000:2.0:1786960809.449527:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97f81d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef7 expref: 24 pid: 5811 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.449560:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5813:1873763967760128:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960809.449582:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.449590:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.449596:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960809.449883:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1786960809.450075:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1786960809.450178:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1873763967760256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786960809.450418:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960809.450452:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b420180 going to sleep for 11 seconds 00000100:00100000:3.0:1786960809.450518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967760256 00000100:00100000:3.0:1786960809.450525:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967760256 00000100:00100000:3.0:1786960809.450579:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960809.450588:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1873763967760256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1786960809.450923:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960809.451010:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1873763967760256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 423us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960809.451025:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960809.451100:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1873763967760256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786960809.451964:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1786960809.452061:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1873763967760384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786960809.452099:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960809.452117:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766472f6540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960809.453463:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967760384 00000100:00100000:3.0:1786960809.453473:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967760384 00000100:00100000:3.0:1786960809.453519:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960809.453527:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1873763967760384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786960809.453726:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1873763967760384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (1626us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1786960809.453732:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786960809.453911:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1873763967760384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786960809.453976:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1786960809.454026:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454036:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454043:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454049:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fe00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960809.454054:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454076:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454091:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960809.454094:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786960809.454098:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960809.454104:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97f88d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786960809.454436:0:5813:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786960809.454729:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1786960809.454740:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291481552673ns, next at 292481550418ns, rc = 0 00000001:00080000:1.0:1786960809.454866:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1786960809.454901:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496200) 00010000:00010000:1.0:1786960809.454904:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786960809.454912:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97f878 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf21 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960809.455067:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10297:x1873763958290176:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 13896us (14032us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1786960809.455075:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000020:00080000:1.0:1786960809.455080:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786960809.458373:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.458531:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958290432 00000100:00100000:2.0:1786960809.458540:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958290432 00000100:00100000:2.0:1786960809.458598:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960809.458607:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10297:x1873763958290432:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960809.458636:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960809.458667:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf28 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.458719:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf28 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.458732:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f894 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf28 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.458867:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960809.458870:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960809.458874:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f600, rc 0) 00000100:00100000:2.0:1786960809.458961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10297:x1873763958290432:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 354us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960809.458968:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960809.463472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.463545:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958290688 00000100:00100000:0.0:1786960809.463554:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958290688 00000100:00100000:0.0:1786960809.463819:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1786960809.463836:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10297:x1873763958290688:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960809.464072:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10297:x1873763958290688:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 242us (608us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1786960809.467213:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1786960809.577158:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.577274:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958290944 00000100:00100000:0.0:1786960809.577283:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958290944 00000100:00100000:0.0:1786960809.577345:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1786960809.577355:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10307:x1873763958290944:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960809.577388:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960809.577406:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97f89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf2f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960809.577511:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1786960809.577625:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97f89b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf2f expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.577645:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960809.577648:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960809.577652:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97f89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf2f expref: 31 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.577674:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:0.0:1786960809.577726:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10307:x1873763958290944:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 373us (575us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1786960809.577733:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1786960809.582788:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.582897:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958291072 00000100:00100000:2.0:1786960809.582907:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958291072 00000100:00100000:2.0:1786960809.582952:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1786960809.582958:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10307:x1873763958291072:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1786960809.583034:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583051:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583063:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583095:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583104:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583111:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583234:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583255:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583262:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960809.583309:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583322:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583330:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583336:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583341:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ec00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960809.583345:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583359:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583372:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960809.583375:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960809.583379:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583386:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97f8a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583399:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583408:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583414:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583419:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960809.583421:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583426:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583432:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976664f8cf00) 00010000:00010000:2.0:1786960809.583435:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960809.583437:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583452:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583466:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583476:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583482:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583486:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960809.583489:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583495:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583502:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960809.583504:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960809.583507:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.583512:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97f8b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.583698:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10307:x1873763958291072:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 737us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960809.583706:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1786960809.589672:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960809.589818:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958291328 00000100:00100000:1.0:1786960809.589828:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958291328 00000100:00100000:1.0:1786960809.589884:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1786960809.589894:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10307:x1873763958291328:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960809.590162:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10307:x1873763958291328:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 268us (500us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1786960809.590171:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1786960809.652988:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.653089:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958291584 00000100:00100000:0.0:1786960809.653098:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958291584 00000100:00100000:0.0:1786960809.653526:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1786960809.653536:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10310:x1873763958291584:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960809.653557:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960809.653576:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97f8be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf36 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653668:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653696:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653706:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653720:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653726:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.653731:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.654847:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.654859:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.654868:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960809.654877:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1786960809.654974:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.654981:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.654987:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655003:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960809.655007:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655027:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655040:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960809.655043:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960809.655048:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655054:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97f8c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655076:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655082:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655088:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655093:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960809.655096:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655102:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655120:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de000) 00010000:00010000:0.0:1786960809.655123:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960809.655125:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655131:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97f8cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655228:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97f8be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655255:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960809.655263:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960809.655265:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960809.655268:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960809.655624:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10310:x1873763958291584:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2088us (2644us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1786960809.655640:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1786960809.660849:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960809.660943:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958291712 00000100:00100000:2.0:1786960809.660953:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958291712 00000100:00100000:2.0:1786960809.661049:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1786960809.661059:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10310:x1873763958291712:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1786960809.661121:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661137:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661147:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661171:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661177:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661183:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661214:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960809.661218:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661225:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661235:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960809.661237:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960809.661260:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960809.661266:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97f8e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960809.661338:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10310:x1873763958291712:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 280us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960809.661345:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960809.663926:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960809.664081:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958291968 00000100:00100000:0.0:1786960809.664091:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958291968 00000100:00100000:0.0:1786960809.664138:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1786960809.664146:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10310:x1873763958291968:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960809.664876:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:10310:x1873763958291968:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 728us (956us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1786960809.664898:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1786960810.036263:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960810.036339:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958292224 00000100:00100000:3.0:1786960810.036349:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958292224 00000100:00100000:3.0:1786960810.036417:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1786960810.036427:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:10341:x1873763958292224:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1786960810.036449:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960810.036466:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f8e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf3d expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.036554:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.036567:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.036579:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960810.036606:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1786960810.036763:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f8e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf3d expref: 37 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.036782:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf3d expref: 36 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.036790:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960810.036793:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960810.036796:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169be00, rc 0) 00000100:00100000:3.0:1786960810.036858:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10341:x1873763958292224:12345-192.168.203.23@tcp:101:cat.0 Request processed in 433us (614us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1786960810.036865:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00080000:2.0:1786960810.037215:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960810.044926:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960810.045094:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958292480 00000100:00100000:1.0:1786960810.045104:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958292480 00000100:00100000:1.0:1786960810.045163:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1786960810.045174:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10341:x1873763958292480:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:1.0:1786960810.045491:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:10341:x1873763958292480:12345-192.168.203.23@tcp:35:cat.0 Request processed in 319us (572us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1786960810.045499:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1786960810.048698:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960810.048934:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958292608 00000100:00100000:3.0:1786960810.048944:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958292608 00000100:00100000:3.0:1786960810.049006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1786960810.049023:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:2343:x1873763958292608:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960810.049038:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960810.049063:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf3d expref: 37 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.049083:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960810.049088:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960810.049150:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:2343:x1873763958292608:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 128us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960810.049173:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1786960810.131736:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960810.131894:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958292864 00000100:00100000:1.0:1786960810.131904:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958292864 00000100:00100000:1.0:1786960810.131957:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1786960810.131966:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10347:x1873763958292864:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:1.0:1786960810.131988:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960810.131991:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786960810.132030:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf13 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132048:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960810.132051:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960810.132064:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97f8fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf44 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132165:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132177:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132225:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132263:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 36 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.132275:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 36 pid: 5811 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960810.132287:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967760512:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960810.132374:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665979c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960810.140727:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967760512:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960810.140825:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960810.144489:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960810.145143:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958292992 00000100:00100000:3.0:1786960810.145153:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958292992 00010000:00010000:3.0:1786960810.145220:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 37 pid: 5811 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960810.145375:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1786960810.145385:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:2343:x1873763958292992:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960810.145401:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960810.145408:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 37 pid: 5811 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145421:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 37 pid: 5811 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145444:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f8d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf36 expref: 37 pid: 5811 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145459:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960810.145464:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145473:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145481:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.145530:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960810.145604:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:2343:x1873763958292992:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 219us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960810.145631:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00010000:00010000:1.0:1786960810.146182:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.147616:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960810.147645:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786960810.148058:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97f8fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.148078:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.148088:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:1.0:1786960810.148091:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786960810.148094:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93000, rc 0) 00000100:00100000:1.0:1786960810.148159:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10347:x1873763958292864:12345-192.168.203.23@tcp:101:dd.0 Request processed in 16194us (16433us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1786960810.148168:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1786960810.152749:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960810.153091:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958293248 00000100:00100000:3.0:1786960810.153100:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958293248 00000100:00100000:3.0:1786960810.153158:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1786960810.153168:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10347:x1873763958293248:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:3.0:1786960810.153553:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.153568:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.153589:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960810.153984:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1786960810.154085:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000792081ed reply state 00000000d1b6f6a2 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960810.154095:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786960810.154282:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:10347:x1873763958293248:12345-192.168.203.23@tcp:36:dd.0 Request processed in 1113us (1539us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1786960810.154290:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000020:00080000:3.0:1786960810.154294:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786960810.164639:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164677:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164686:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164692:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169be00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960810.164698:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164707:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164725:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960810.164728:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960810.164733:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.164750:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f912 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.228842:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786960810.382062:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000001:00080000:2.0:1786960810.382090:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000004:00080000:2.0:1786960810.382100:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1786960810.382130:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97666b420180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1786960810.382134:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9766502d5e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97666b420b40 00000020:00080000:2.0:1786960810.382138:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9766502d5600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff976651413800 00000001:00080000:2.0:1786960810.382162:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000020:00080000:3.0:1786960810.382217:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1786960810.382345:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1786960810.382581:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960810.382600:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967760640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786960810.382686:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960810.386348:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967760640 00000100:00100000:0.0:1786960810.386362:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967760640 00000100:00100000:0.0:1786960810.386440:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786960810.386450:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967760640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786960810.386478:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1786960810.386509:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a82dba9, atime: 0x6a82dba9, ctime: 0x6a82dba9, blocks: 0x1 00010000:00010000:0.0:1786960810.386516:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.386532:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=292s v=(0 0) 00010000:00010000:0.0:1786960810.386536:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960810.386541:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.386558:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.386568:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.386576:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.386598:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786960810.387160:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1873763967760640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 710us (4472us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1786960810.387168:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1786960810.387260:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766597a5180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1786960810.387267:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967760640:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786960810.387465:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960810.387472:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.387481:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960810.387485:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.387507:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.387527:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.387535:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97f919 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.387555:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960810.387557:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960810.387559:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960810.470233:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960810.470428:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958293376 00000100:00100000:0.0:1786960810.470436:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958293376 00000100:00100000:0.0:1786960810.470497:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1786960810.470507:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:10361:x1873763958293376:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:0.0:1786960810.470530:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960810.470552:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf4b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470633:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470646:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470656:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470671:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470677:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.470683:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.471050:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.471061:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.471069:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.471102:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.471115:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 12 pid: 5812 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960810.471127:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967760768:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960810.471244:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a81ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960810.474659:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960810.474832:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958293632 00000100:00100000:1.0:1786960810.474840:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958293632 00000100:00100000:1.0:1786960810.474894:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1786960810.474903:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:5581:x1873763958293632:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1786960810.475338:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:5581:x1873763958293632:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 435us (686us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1786960810.475346:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960810.476400:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967760768:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960810.476426:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960810.478652:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960810.478781:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958293760 00000100:00100000:2.0:1786960810.478789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958293760 00010000:00010000:2.0:1786960810.478823:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 14 pid: 5812 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960810.478857:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1786960810.478877:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2344:x1873763958293760:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960810.478890:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960810.478896:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 14 pid: 5812 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478908:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 14 pid: 5812 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478928:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97f904 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf44 expref: 14 pid: 5812 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478943:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960810.478948:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478957:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478964:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960810.478990:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960810.479163:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479171:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960810.479246:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786960810.479255:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960810.479285:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479297:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479307:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479313:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479319:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479324:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960810.479328:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479335:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479343:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960810.479346:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960810.479350:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479356:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479366:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479380:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479386:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479391:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960810.479394:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479399:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479406:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de200) 00010000:00010000:0.0:1786960810.479408:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960810.479411:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479417:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f92e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479446:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf4b expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479457:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf4b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.479464:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960810.479466:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960810.479473:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1000, rc 0) 00000100:00100000:0.0:1786960810.479520:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10361:x1873763958293376:12345-192.168.203.23@tcp:101:stat.0 Request processed in 9015us (9296us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960810.479527:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:2.0:1786960810.479660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2344:x1873763958293760:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 784us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960810.479668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:3.0:1786960810.579848:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960810.579954:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958294016 00000100:00100000:0.0:1786960810.579963:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958294016 00000100:00100000:0.0:1786960810.580026:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:0.0:1786960810.580036:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:10367:x1873763958294016:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:0.0:1786960810.580089:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960810.580216:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf4b expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.580297:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960810.580303:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960810.580548:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.580562:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.580571:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960810.580691:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1786960810.580720:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000488165d reply state 000000002f18646a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960810.580730:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960810.581061:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10367:x1873763958294016:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 1025us (1322us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1786960810.581085:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000020:00080000:0.0:1786960810.581091:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786960810.587437:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587452:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587460:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587466:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960810.587470:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587478:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587511:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960810.587514:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960810.587519:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960810.587538:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f93c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960810.804930:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967760896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960810.805000:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960810.805532:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967761024:0@lo:400:kworker.0 00000100:00100000:0.0:1786960810.805569:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960810.805616:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967761024 00000100:00100000:0.0:1786960810.805623:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967761024 00000100:00100000:0.0:1786960810.805665:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786960810.805673:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967761024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960810.805731:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967761024:12345-0@lo:400:kworker.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960810.805737:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786960810.805780:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967761024:0@lo:400:kworker.0 00000100:00100000:2.0:1786960810.805954:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967760896 00000100:00100000:2.0:1786960810.805959:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967760896 00000100:00100000:2.0:1786960810.806000:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1786960810.806017:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967760896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960810.806057:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1786960810.806127:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960810.806848:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967761152:0@lo:400:kworker.0 00000100:00100000:0.0:1786960810.806882:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960810.806994:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786960810.807001:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967761280:0@lo:400:kworker.0 00000100:00100000:0.0:1786960810.807033:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960810.807059:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967761152 00000100:00100000:0.0:1786960810.807065:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967761152 00000100:00100000:0.0:1786960810.807092:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967761280 00000100:00100000:0.0:1786960810.807094:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967761280 00000100:00100000:2.0:1786960810.807222:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967760896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1214us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960810.807230:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786960810.807357:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967760896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960810.807460:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786960810.807469:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967761152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960810.807511:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967761152:12345-0@lo:400:kworker.0 Request processed in 44us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960810.807516:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1786960810.807528:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1786960810.807534:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967761280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960810.807558:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967761280:12345-0@lo:400:kworker.0 Request processed in 25us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960810.807563:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1786960810.807587:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967761280:0@lo:400:kworker.0 00000100:00100000:2.0:1786960810.807596:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976673ad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967761152:0@lo:400:kworker.0 00000100:00100000:1.0:1786960810.807796:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967761408:0@lo:400:kworker.0 00000100:00100000:1.0:1786960810.807826:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786960810.807858:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960810.807868:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967761408 00000100:00100000:1.0:1786960810.807872:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967761408 00000100:00100000:1.0:1786960810.807915:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1786960810.807922:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967761408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960810.807955:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967761408:12345-0@lo:400:kworker.0 Request processed in 34us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960810.807961:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1786960810.807974:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960810.807994:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967761408:0@lo:400:kworker.0 00000100:00100000:3.0:1786960810.810705:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960810.810878:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958294144 00000100:00100000:1.0:1786960810.810887:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958294144 00000100:00100000:1.0:1786960810.810952:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960810.810961:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10381:x1873763958294144:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:1.0:1786960810.810985:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960810.811015:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf52 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811082:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811095:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811117:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811133:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811140:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811165:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811529:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811539:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811547:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960810.811581:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1786960810.811585:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960810.811614:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811625:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811635:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811641:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811647:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811653:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960810.811657:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811672:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811685:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960810.811689:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960810.811694:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811700:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97f94a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811727:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811733:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811739:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811744:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960810.811747:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811753:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811759:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976661496200) 00010000:00010000:1.0:1786960810.811761:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960810.811763:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811779:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97f951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811811:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97f943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811824:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960810.811832:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:1.0:1786960810.811835:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960810.811837:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93600, rc 0) 00000100:00100000:1.0:1786960810.811899:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10381:x1873763958294144:12345-192.168.203.23@tcp:101:stat.0 Request processed in 938us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960810.811906:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960810.995947:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960810.996061:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958294400 00000100:00100000:0.0:1786960810.996071:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958294400 00000100:00100000:0.0:1786960810.996129:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1786960810.996139:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10391:x1873763958294400:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960810.996171:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960810.996227:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f95f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf59 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960810.996492:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1786960810.996666:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f95f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf59 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.996681:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960810.996685:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960810.996690:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f95f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf59 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960810.996704:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960810.996771:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10391:x1873763958294400:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 633us (832us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1786960810.996779:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1786960811.003089:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960811.003725:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958294656 00000100:00100000:1.0:1786960811.003735:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958294656 00000100:00100000:1.0:1786960811.003797:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1786960811.003806:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10391:x1873763958294656:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960811.004282:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:10391:x1873763958294656:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 475us (1200us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1786960811.004290:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1786960811.108289:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.108386:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958294912 00000100:00100000:0.0:1786960811.108396:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958294912 00000100:00100000:0.0:1786960811.108454:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:0.0:1786960811.108463:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:10397:x1873763958294912:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960811.108491:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960811.108513:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f96d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf60 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.108614:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.108653:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.108662:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.108695:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.108715:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 17 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960811.108730:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967761536:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960811.108821:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766472f6540 going to sleep for 11 seconds 00000100:00100000:1.0:1786960811.114431:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960811.114533:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958295040 00000100:00100000:2.0:1786960811.114542:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958295040 00010000:00010000:2.0:1786960811.114582:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 18 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960811.114627:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1786960811.114637:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958295040:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960811.114651:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960811.114671:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 18 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.114685:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 18 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.114719:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960811.114724:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.114734:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.114741:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.114764:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960811.114817:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958295040:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 181us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960811.114824:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00010000:00010000:0.0:1786960811.115848:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97f958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf52 expref: 17 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960811.115867:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681637800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967761536:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960811.115886:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.115894:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.115900:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960811.115920:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1786960811.116084:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f96d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.116099:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.116107:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960811.116110:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960811.116112:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1000, rc 0) 00000100:00100000:0.0:1786960811.116285:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10397:x1873763958294912:12345-192.168.203.23@tcp:101:bash.0 Request processed in 7822us (8004us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1786960811.116292:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1786960811.131303:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.131493:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958295296 00000100:00100000:0.0:1786960811.131503:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958295296 00000100:00100000:0.0:1786960811.131560:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:0.0:1786960811.131570:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10397:x1873763958295296:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1786960811.131915:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.131932:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.131945:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960811.131995:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1786960811.132032:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d09e77c reply state 00000000ea179f76 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960811.132041:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960811.132137:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10397:x1873763958295296:12345-192.168.203.23@tcp:36:bash.0 Request processed in 568us (843us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1786960811.132144:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000020:00080000:0.0:1786960811.132149:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960811.140877:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140896:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140905:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140912:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960811.140917:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140944:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140963:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:2.0:1786960811.140967:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960811.140971:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960811.140978:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97f982 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960811.142381:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960811.142906:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958295424 00000100:00100000:3.0:1786960811.142916:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958295424 00000100:00100000:3.0:1786960811.142975:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1786960811.142985:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10397:x1873763958295424:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960811.143026:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960811.143046:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf67 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.143125:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.143141:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.143149:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.143227:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.143251:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 20 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960811.143264:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967761664:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960811.143346:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96900 going to sleep for 11 seconds 00000100:00100000:2.0:1786960811.152451:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967761664:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960811.152482:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960811.153105:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960811.153606:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958295552 00000100:00100000:3.0:1786960811.153628:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958295552 00010000:00010000:3.0:1786960811.153665:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 21 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960811.153703:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:3.0:1786960811.153826:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:2343:x1873763958295552:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960811.153841:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960811.153848:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 21 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153862:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 21 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153884:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97f974 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf60 expref: 21 pid: 5811 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153900:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960811.153918:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153929:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153936:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.153970:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960811.154031:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:2343:x1873763958295552:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 208us (929us total) trans 0 rc 0/0 00010000:00010000:0.0:1786960811.154080:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.154088:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960811.154130:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786960811.154134:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960811.154150:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.154179:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf67 expref: 21 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.154224:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf67 expref: 20 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.154232:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960811.154234:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960811.154236:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ac00, rc 0) 00000100:00100000:0.0:1786960811.154273:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10397:x1873763958295424:12345-192.168.203.23@tcp:101:bash.0 Request processed in 11290us (11900us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.154281:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1786960811.158025:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:3.0:1786960811.158760:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960811.158883:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958295808 00000100:00100000:1.0:1786960811.158893:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958295808 00000100:00100000:1.0:1786960811.158947:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1786960811.158956:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10397:x1873763958295808:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1786960811.159248:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10397:x1873763958295808:12345-192.168.203.23@tcp:35:bash.0 Request processed in 293us (489us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1786960811.159256:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:2.0:1786960811.252349:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960811.282973:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.283090:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296064 00000100:00100000:0.0:1786960811.283101:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296064 00000100:00100000:0.0:1786960811.283160:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1786960811.283223:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10407:x1873763958296064:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960811.283262:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960811.283282:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf6e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960811.283532:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1786960811.283714:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f997 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf6e expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.284474:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960811.284479:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960811.284485:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf6e expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.284501:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0000, rc 0) 00000100:00100000:0.0:1786960811.284573:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10407:x1873763958296064:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1389us (1609us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1786960811.284582:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:1.0:1786960811.298405:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.298500:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296192 00000100:00100000:0.0:1786960811.298509:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296192 00000100:00100000:0.0:1786960811.298571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:0.0:1786960811.298581:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10407:x1873763958296192:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1786960811.298666:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.298683:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.298711:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.298733:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.298741:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.298748:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299095:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299104:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299111:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960811.299156:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299170:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299177:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299184:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299248:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.299252:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299260:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299273:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960811.299276:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960811.299280:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299286:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97f9a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299298:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299303:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299308:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299313:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.299315:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299320:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299342:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de200) 00010000:00010000:0.0:1786960811.299345:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960811.299347:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299352:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97f9ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299365:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299370:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299374:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299379:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.299382:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299388:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299395:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960811.299396:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960811.299401:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.299406:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960811.299484:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10407:x1873763958296192:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 903us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.299492:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:3.0:1786960811.312451:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960811.312581:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296448 00000100:00100000:1.0:1786960811.312590:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296448 00000100:00100000:1.0:1786960811.312650:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1786960811.312658:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10407:x1873763958296448:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960811.313056:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10407:x1873763958296448:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 397us (612us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1786960811.313064:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1786960811.316968:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960811.316992:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967761792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960811.317066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960811.317258:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967761792 00000100:00100000:3.0:1786960811.317266:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967761792 00000100:00100000:3.0:1786960811.317330:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786960811.317340:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1873763967761792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960811.317376:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960811.317425:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1873763967761792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960811.317432:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786960811.317474:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967761792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786960811.317615:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960811.401065:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960811.401157:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296704 00000100:00100000:3.0:1786960811.401167:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296704 00000100:00100000:3.0:1786960811.401259:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1786960811.401269:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10410:x1873763958296704:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960811.401310:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960811.401331:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f9ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf75 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401406:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401421:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401433:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401450:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401457:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401463:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401832:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f9cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401842:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f9cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401848:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f9cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960811.401858:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786960811.401956:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401964:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401970:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401977:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960811.401981:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401988:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.401999:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:3.0:1786960811.402012:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960811.402016:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402022:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b400/0x1808d16e4c97f9c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402036:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402042:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402048:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402053:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169be00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960811.402061:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402068:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402076:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976643e01800) 00010000:00010000:3.0:1786960811.402078:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960811.402081:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402086:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402131:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f9ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf75 expref: 25 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402145:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f9cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf75 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.402152:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960811.402155:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960811.402157:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b600, rc 0) 00000100:00100000:3.0:1786960811.402443:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10410:x1873763958296704:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1174us (1388us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1786960811.402451:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:1.0:1786960811.407413:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.407694:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296832 00000100:00100000:0.0:1786960811.407704:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296832 00000100:00100000:0.0:1786960811.407760:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1786960811.407771:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10410:x1873763958296832:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1786960811.407841:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407858:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407870:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407898:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407905:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407912:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407918:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.407922:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407929:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407954:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:0.0:1786960811.407956:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960811.407962:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.407967:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960811.408050:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10410:x1873763958296832:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 280us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.408056:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:1.0:1786960811.408641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960811.408685:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958296960 00000100:00100000:1.0:1786960811.408691:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958296960 00000100:00100000:1.0:1786960811.408727:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1786960811.408736:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:2343:x1873763958296960:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960811.408749:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960811.408773:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97f9cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf75 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960811.408788:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:1.0:1786960811.408792:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960811.408816:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:2343:x1873763958296960:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 83us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960811.408822:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1786960811.411812:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960811.411903:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958297216 00000100:00100000:2.0:1786960811.411913:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958297216 00000100:00100000:2.0:1786960811.411990:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1786960811.412082:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:10410:x1873763958297216:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960811.412352:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10410:x1873763958297216:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 353us (551us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1786960811.412360:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960811.672571:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960811.674692:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958297472 00000100:00100000:3.0:1786960811.674707:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958297472 00000100:00100000:3.0:1786960811.674780:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1786960811.674790:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10428:x1873763958297472:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1786960811.674825:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960811.674846:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf7c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.674941:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.674956:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.674967:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960811.674978:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786960811.675109:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97f9e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf7c expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.675128:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf7c expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.675138:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960811.675141:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786960811.675144:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169be00, rc 0) 00000100:00100000:3.0:1786960811.675311:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10428:x1873763958297472:12345-192.168.203.23@tcp:101:cat.0 Request processed in 521us (2761us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1786960811.675319:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1786960811.749538:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.749647:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958297600 00000100:00100000:0.0:1786960811.749667:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958297600 00000100:00100000:0.0:1786960811.749725:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:0.0:1786960811.749744:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10429:x1873763958297600:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960811.749768:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960811.749789:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf83 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.749853:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.749867:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.749878:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960811.750088:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1786960811.750092:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960811.750167:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.750222:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97f9f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf83 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.750240:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf83 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.750248:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960811.750251:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960811.750254:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0000, rc 0) 00000100:00100000:0.0:1786960811.750321:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10429:x1873763958297600:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 579us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.750328:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1786960811.762561:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960811.762710:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958297984 00000100:00100000:2.0:1786960811.762741:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958297984 00000100:00100000:2.0:1786960811.762823:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:2.0:1786960811.762836:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10429:x1873763958297984:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960811.763323:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10429:x1873763958297984:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 488us (775us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1786960811.763333:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1786960811.767058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960811.767216:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298112 00000100:00100000:3.0:1786960811.767239:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298112 00000100:00100000:3.0:1786960811.767362:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960811.767376:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10429:x1873763958298112:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1786960811.767400:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1786960811.767436:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97f990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf67 expref: 28 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.767465:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97f9eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf7c expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.767481:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97f894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf28 expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960811.767493:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976664f8c600) 00010000:00010000:3.0:1786960811.767506:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960811.767585:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:10429:x1873763958298112:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 212us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960811.767593:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960811.770863:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.772025:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298240 00000100:00100000:0.0:1786960811.772042:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298240 00000100:00100000:0.0:1786960811.772134:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:0.0:1786960811.772147:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:10429:x1873763958298240:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:0.0:1786960811.772357:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.772378:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.772394:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960811.773183:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786960811.773426:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1786960811.773512:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1786960811.773667:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:10429:x1873763958298240:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 1516us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.773677:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:1.0:1786960811.808684:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960811.808809:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298368 00000100:00100000:0.0:1786960811.808823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298368 00000100:00100000:0.0:1786960811.808901:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:0.0:1786960811.808914:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:10431:x1873763958298368:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960811.808943:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960811.808972:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fa0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf8a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809074:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809092:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809106:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809124:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809131:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809163:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809575:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809585:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809593:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960811.809639:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786960811.809644:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960811.809666:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809679:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809688:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809694:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809701:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809708:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.809712:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809727:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809742:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960811.809746:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960811.809751:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809758:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fa15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809772:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809779:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809784:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809791:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960811.809793:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809799:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809807:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de000) 00010000:00010000:0.0:1786960811.809809:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960811.809812:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809827:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fa1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809867:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fa0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809882:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960811.809890:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:0.0:1786960811.809893:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960811.809895:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:0.0:1786960811.809969:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10431:x1873763958298368:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1058us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960811.809978:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00010000:00010000:3.0:1786960812.276477:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960812.534698:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960812.534710:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786960812.534766:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1786960812.535101:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786960812.535295:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967761920:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786960812.537541:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960812.549742:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967761920:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786960812.557055:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.560343:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298496 00000100:00100000:0.0:1786960812.560366:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298496 00000100:00100000:0.0:1786960812.560531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960812.560546:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298496:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00080000:2.0:1786960812.560721:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960812.561447:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298496:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 891us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.561459:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:1.0:1786960812.575780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960812.575882:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298624 00000100:00100000:3.0:1786960812.575895:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298624 00000100:00100000:3.0:1786960812.575964:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1786960812.575975:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298624:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786960812.576029:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786960812.576162:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298624:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 189us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960812.576171:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1786960812.586740:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.586814:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958298752 00000100:00100000:2.0:1786960812.586828:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958298752 00000100:00100000:2.0:1786960812.586894:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1786960812.586906:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298752:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.587019:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.587037:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.587050:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.588946:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.588976:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589020:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589067:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589078:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589086:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960812.589374:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786960812.589380:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960812.589398:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589415:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589423:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589431:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589439:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960812.589444:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589453:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589791:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960812.589795:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960812.589802:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589809:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fa2a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589823:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589829:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589835:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589842:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960812.589844:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589851:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589859:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9766559de000) 00010000:00010000:0.0:1786960812.589862:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960812.589864:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589870:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fa31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.589986:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590003:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590010:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590015:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960812.590018:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590025:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590034:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:0.0:1786960812.590037:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960812.590040:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.590047:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fa38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960812.590183:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958298752:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 3271us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.590220:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1786960812.594162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960812.594472:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958299008 00000100:00100000:3.0:1786960812.594489:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958299008 00000100:00100000:3.0:1786960812.594563:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1786960812.594574:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10442:x1873763958299008:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960812.594602:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960812.594640:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97fa3f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf91 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594773:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594791:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594806:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960812.594818:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1786960812.594951:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594960:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594967:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594974:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960812.594980:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.594988:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.595380:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:3.0:1786960812.595383:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960812.595390:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960812.595397:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fa46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.595592:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97fa3f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf91 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.595628:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960812.595631:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960812.595635:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97fa3f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf91 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.595651:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169be00, rc 0) 00000100:00100000:0.0:1786960812.595814:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299008:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1240us (1659us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1786960812.595824:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:1.0:1786960812.606963:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960812.607044:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958299136 00000100:00100000:3.0:1786960812.607058:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958299136 00000100:00100000:3.0:1786960812.607140:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:3.0:1786960812.607151:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299136:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786960812.607231:0:8734:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786960812.607368:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299136:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 218us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960812.607376:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:0.0:1786960812.615765:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.615864:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958299392 00000100:00100000:2.0:1786960812.615877:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958299392 00000100:00100000:2.0:1786960812.616118:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:2.0:1786960812.616130:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299392:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.616159:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960812.616169:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786960812.616233:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fa00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf83 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.616255:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960812.616260:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960812.616379:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf98 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960812.624117:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1786960812.625384:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fa5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.625408:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.625423:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.625505:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf98 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.625523:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fa5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf98 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.625533:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8cf00) 00010000:00010000:2.0:1786960812.625536:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960812.625541:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f600, rc 0) 00000100:00100000:2.0:1786960812.626134:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10442:x1873763958299392:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 10003us (10380us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1786960812.626156:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:3.0:1786960812.634329:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.634477:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958299648 00000100:00100000:2.0:1786960812.634489:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958299648 00000100:00100000:2.0:1786960812.634558:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:2.0:1786960812.634569:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10442:x1873763958299648:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.634710:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960812.634744:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fa5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf98 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.634766:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8cf00) 00010000:00010000:2.0:1786960812.634777:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960812.634804:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.634819:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.634830:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642446:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642470:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642483:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642775:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642783:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642790:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642796:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960812.642801:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642807:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642819:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960812.642822:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960812.642826:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642832:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642842:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642847:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642852:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642864:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960812.642867:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642873:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642880:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6f38dc2a (ffff976664f8cb00) 00010000:00010000:2.0:1786960812.642883:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960812.642885:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.642891:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fa70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6f38dc2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960812.642987:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299648:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 8416us (8669us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786960812.643007:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:0.0:1786960812.647063:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.647232:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958299776 00000100:00100000:2.0:1786960812.647247:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958299776 00000100:00100000:2.0:1786960812.647319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:2.0:1786960812.647330:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10442:x1873763958299776:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.647351:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960812.647378:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bf9f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647414:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647454:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647467:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647563:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647581:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.647589:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960812.647592:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786960812.647595:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ec00, rc 0) 00000100:00100000:2.0:1786960812.647663:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10442:x1873763958299776:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 334us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960812.647671:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:0.0:1786960812.662431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960812.663859:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300032 00000100:00100000:1.0:1786960812.663880:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300032 00000100:00100000:1.0:1786960812.663970:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:1.0:1786960812.663982:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:10442:x1873763958300032:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786960812.664107:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.664129:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.664166:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960812.664549:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1786960812.664560:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294691373457ns, next at 295691370140ns, rc = 0 00000004:00010000:1.0:1786960812.664870:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008166028f reply state 00000000909e56a5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960812.664882:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960812.665028:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10442:x1873763958300032:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 1046us (2610us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1786960812.665036:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00010000:00010000:1.0:1786960812.669105:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669130:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669138:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669146:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960812.669152:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669162:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669225:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:1.0:1786960812.669229:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786960812.669258:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.669265:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fa85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960812.670325:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.670398:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300160 00000100:00100000:2.0:1786960812.670412:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300160 00000100:00100000:2.0:1786960812.670505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:2.0:1786960812.670515:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10442:x1873763958300160:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.670541:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960812.670563:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfa6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.670623:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.670653:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.670673:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960812.670676:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960812.670680:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ee00, rc 0) 00000100:00100000:2.0:1786960812.670757:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10442:x1873763958300160:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 243us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960812.670764:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:3.0:1786960812.673960:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.674040:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300288 00000100:00100000:0.0:1786960812.674055:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300288 00000100:00100000:0.0:1786960812.674121:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1786960812.674130:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1873763958300288:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1786960812.674160:0:6660:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:0.0:1786960812.674212:0:6660:0:(genops.c:1406:class_connect()) connect: client e2d64e27-0ccc-4195-8812-2a972b8bf63c, cookie 0x1808d16e4c97fa93 00002000:00100000:0.0:1786960812.674224:0:6660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e2d64e27-0ccc-4195-8812-2a972b8bf63c/ffff9766520b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786960812.674248:0:6660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786960812.674495:0:6660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786960812.674525:0:6660:0:(import.c:65:import_set_state_nolock()) ffff9766520b3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960812.674600:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2340:x1873763958300288:12345-192.168.203.23@tcp:8:lhsmtool_posix.0 Request processed in 470us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.674621:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1786960812.679489:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.683549:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300416 00000100:00100000:2.0:1786960812.683563:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300416 00000100:00100000:2.0:1786960812.683674:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1786960812.683685:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:0:x1873763958300416:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1786960812.687971:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1786960812.748698:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000001:00080000:0.0:1786960812.748716:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1786960812.749005:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:0:x1873763958300416:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 65307us (69510us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786960812.749017:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:3.0:1786960812.753711:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.753818:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300672 00000100:00100000:0.0:1786960812.753837:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300672 00000100:00100000:0.0:1786960812.753898:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1786960812.753908:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10442:x1873763958300672:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786960812.754151:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10442:x1873763958300672:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 244us (449us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1786960812.754159:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1786960812.758727:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.759155:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958300928 00000100:00100000:0.0:1786960812.759164:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958300928 00000100:00100000:0.0:1786960812.759427:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:0.0:1786960812.759438:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10442:x1873763958300928:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960812.759578:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10442:x1873763958300928:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 141us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.759586:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:0.0:1786960812.765386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.766618:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301056 00000100:00100000:2.0:1786960812.766636:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301056 00000100:00100000:2.0:1786960812.766720:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1786960812.766733:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10442:x1873763958301056:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960812.766760:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960812.766789:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.766907:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.766931:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.766945:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960812.767004:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960812.767029:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.767065:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fa9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfad expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.767089:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfad expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960812.767101:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960812.767105:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786960812.767108:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f600, rc 0) 00000100:00100000:2.0:1786960812.767230:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10442:x1873763958301056:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 500us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960812.767238:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1786960812.774278:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960812.777397:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301184 00000100:00100000:1.0:1786960812.777417:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301184 00000100:00100000:1.0:1786960812.778291:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1786960812.778306:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958301184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960812.778330:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960812.778357:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfb4 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960812.778393:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a82dbad, blocks: 0x1 00010000:00010000:1.0:1786960812.778421:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=294s v=(0 0) 00010000:00010000:1.0:1786960812.778427:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960812.779044:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.779078:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.779095:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92000, rc 0) 00000100:00100000:1.0:1786960812.779705:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958301184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 886us (4919us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960812.779738:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1786960812.786306:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.786378:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301440 00000100:00100000:0.0:1786960812.786397:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301440 00000100:00100000:0.0:1786960812.786672:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1786960812.786685:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10442:x1873763958301440:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960812.786840:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10442:x1873763958301440:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 157us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.786862:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1786960812.799177:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960812.799401:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301568 00000100:00100000:1.0:1786960812.799417:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301568 00000100:00100000:1.0:1786960812.799490:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1786960812.799503:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:10442:x1873763958301568:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960812.799525:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960812.801139:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfbb expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.801214:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.801226:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960812.801231:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960812.801237:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.801290:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.801312:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 7 pid: 6660 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960812.801330:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967762048:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960812.801455:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960812.818476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.820228:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301696 00000100:00100000:0.0:1786960812.820246:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301696 00010000:00010000:0.0:1786960812.820310:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 8 pid: 6660 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960812.820361:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1786960812.820373:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958301696:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960812.820391:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960812.820419:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 8 pid: 6660 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.820435:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 8 pid: 6660 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.820472:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960812.820478:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960812.820488:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.820501:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960812.823709:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960812.823743:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1873763967762176:192.168.203.23@tcp:105: 00000100:00100000:0.0:1786960812.823943:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42480 going to sleep for 11 seconds 00010000:00010000:1.0:1786960812.825760:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000658ebc7/0x1808d16e4c97faa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfb4 expref: 8 pid: 6660 timeout: 394 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960812.825793:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967762048:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960812.825835:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960812.825853:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93400, rc 0) 00000100:00100000:0.0:1786960812.826835:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:10442:x1873763958301568:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 27325us (27664us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.826848:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:3.0:1786960812.848691:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960812.848744:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301824 00000100:00100000:3.0:1786960812.848756:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301824 00002000:00100000:3.0:1786960812.848810:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9766770f1500 x1873763958301824/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:398/0 lens 504/0 e 0 to 0 dl 1786960823 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960812.848836:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766770f1500 with x1873763958301824 ext(0->8) 00002000:00010000:3.0:1786960812.848842:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766770f1500 00000100:00100000:3.0:1786960812.848873:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960812.848884:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958301824:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786960812.850372:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958301824:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 1482us (1688us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1786960812.850384:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00002000:00100000:3.0:1786960812.850394:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9766770f1500 x1873763958301824/t4294967302(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:398/0 lens 504/448 e 0 to 0 dl 1786960823 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960812.850404:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766770f1500 with x1873763958301824 ext(0->8) 00002000:00010000:3.0:1786960812.850410:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766770f1500 00000100:00100000:1.0:1786960812.850672:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770ff100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1873763967762176:192.168.203.23@tcp:105: 00010000:00010000:1.0:1786960812.850700:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960812.850724:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958301696:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 30353us (32264us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960812.850733:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1786960812.853771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960812.853968:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958301952 00000100:00100000:2.0:1786960812.853981:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958301952 00000100:00100000:2.0:1786960812.854061:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:2.0:1786960812.854072:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10442:x1873763958301952:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1786960812.915037:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10442:x1873763958301952:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 60446us (60759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960812.915057:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000001:00080000:1.0:1786960812.915109:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1786960812.915142:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1786960812.915203:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1786960812.915874:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1786960812.915889:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1786960812.915897:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960812.915918:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967762304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960812.916677:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960812.916755:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967762304 00000100:00100000:1.0:1786960812.916764:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967762304 00000100:00100000:1.0:1786960812.916836:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786960812.916847:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967762304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786960812.917739:0:8239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786960812.917745:0:8239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786960813 00002000:00010000:1.0:1786960812.917748:0:8239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786960812.917750:0:8239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786960813 -> 1786960813 00002000:00010000:1.0:1786960812.917753:0:8239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786960812.917880:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967762304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1032us (1202us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1786960812.917889:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1786960812.917923:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1786960812.921928:0:11970:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960812.921941:0:11970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960812.921988:0:11970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786960812.922006:0:11970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1786960812.925333:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff976647b45c00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1786960812.925356:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967762304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1786960812.925838:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960812.926031:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302080 00000100:00100000:0.0:1786960812.926042:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302080 00000100:00100000:0.0:1786960812.926114:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960812.926127:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958302080:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1786960812.992054:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1786960812.992092:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1786960812.992384:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958302080:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 66063us (66352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960812.992410:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1786960813.008658:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.008956:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302336 00000100:00100000:3.0:1786960813.008969:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302336 00000100:00100000:3.0:1786960813.009047:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:3.0:1786960813.009058:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10442:x1873763958302336:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786960813.009126:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960813.009161:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97faa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfad expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.009182:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960813.009235:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960813.009270:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.009285:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.009296:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960813.009616:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f28a6772 reply state 0000000012beed83 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.009627:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786960813.009746:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10442:x1873763958302336:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 688us (1100us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1786960813.009753:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:3.0:1786960813.013428:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013452:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013462:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013470:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960813.013477:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013486:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013521:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960813.013524:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960813.013531:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.013537:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c97fab6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960813.026645:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960813.026692:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302464 00000100:00100000:1.0:1786960813.026704:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302464 00000100:00100000:1.0:1786960813.026764:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1786960813.026775:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958302464:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786960813.027123:0:8239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1786960813.027127:0:8239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1786960813 -> 1786960811 00002000:00010000:1.0:1786960813.027130:0:8239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786960809 00002000:00010000:1.0:1786960813.027133:0:8239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786960813 -> 1786960811 00002000:00010000:1.0:1786960813.027135:0:8239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786960813.027238:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958302464:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 463us (605us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1786960813.027246:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1786960813.031130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960813.033664:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302720 00000100:00100000:1.0:1786960813.033685:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302720 00000100:00100000:1.0:1786960813.033801:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1786960813.033813:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10442:x1873763958302720:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786960813.033906:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.033927:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.033937:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.033978:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.034006:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 13 pid: 5810 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960813.034026:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967762432:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960813.034419:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960813.038780:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.038830:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302848 00000100:00100000:3.0:1786960813.038842:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302848 00000100:00100000:1.0:1786960813.038870:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967762432:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960813.038892:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 14 pid: 5810 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.038899:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.038930:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1786960813.038940:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2343:x1873763958302848:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960813.038959:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960813.039290:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 14 pid: 5810 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.039306:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 14 pid: 5810 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.039336:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fa7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf9f expref: 14 pid: 5810 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.039352:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960813.039371:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.039382:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.040053:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.040099:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960813.040132:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040141:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040235:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040244:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040251:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040258:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960813.040263:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040271:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040283:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:1.0:1786960813.040286:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786960813.040291:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.040297:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fabd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.042059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2343:x1873763958302848:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3107us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960813.042077:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1786960813.042751:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:10442:x1873763958302720:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 8933us (11627us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786960813.042763:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:3.0:1786960813.049697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960813.050721:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958302976 00000100:00100000:2.0:1786960813.050740:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958302976 00000100:00100000:2.0:1786960813.050850:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1786960813.050863:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2341:x1873763958302976:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786960813.050927:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.050953:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.050972:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1786960813.050978:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786960813.050984:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.051039:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.051056:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 7 pid: 6659 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960813.051077:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681705880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967762560:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960813.051220:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2000 going to sleep for 11 seconds 00000100:00100000:0.0:1786960813.058720:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.059685:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681705880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967762560:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960813.059722:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.059764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958303104 00000100:00100000:3.0:1786960813.059771:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958303104 00010000:00010000:3.0:1786960813.059826:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.059864:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1786960813.059874:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958303104:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960813.059893:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960813.059921:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.059946:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060000:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab2eeb7f/0x1808d16e4c97faaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfbb expref: 8 pid: 6659 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060018:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960813.060024:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960813.060031:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060041:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060070:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960813.060134:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958303104:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 261us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960813.060143:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00010000:00010000:3.0:1786960813.060179:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060740:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060772:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060801:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060810:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060817:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960813.060822:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060831:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060846:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.060854:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eca039f/0x1808d16e4c97fac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.060916:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958302976:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 10054us (11230us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960813.060924:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1786960813.070005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.071371:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958303360 00000100:00100000:3.0:1786960813.071386:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958303360 00000100:00100000:1.0:1786960813.071581:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:1.0:1786960813.071595:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:10442:x1873763958303360:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786960813.071714:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.071736:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.071754:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.072035:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.072060:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.072068:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.072111:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960813.072127:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 13 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960813.072145:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967762688:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960813.072301:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960813.077240:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b44a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967762688:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960813.077281:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960813.078549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.079870:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958303488 00000100:00100000:3.0:1786960813.079895:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958303488 00010000:00010000:3.0:1786960813.079950:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 14 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.080017:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:3.0:1786960813.080030:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2342:x1873763958303488:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960813.080125:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960813.080135:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 14 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.080152:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 14 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.080182:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c97fa8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfa6 expref: 14 pid: 5812 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.080423:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960813.080430:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.080441:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.080449:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.083067:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960813.083177:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2342:x1873763958303488:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3139us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960813.083219:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00010000:00010000:2.0:1786960813.084965:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.084985:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960813.085279:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1786960813.085469:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1786960813.085524:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1786960813.085641:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1873763967762816:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786960813.085728:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960813.085810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967762816 00000100:00100000:2.0:1786960813.085819:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967762816 00000100:00100000:2.0:1786960813.085874:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960813.085885:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1873763967762816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786960813.086001:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1873763967762816:12345-0@lo:1000:mdt00_001.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960813.086009:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960813.086042:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960813.086070:0:5811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1786960813.086076:0:5811:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff976647b45c00, transno 4294967303 00000100:00100000:2.0:1786960813.086098:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1873763967762816:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786960813.086657:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1786960813.086733:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1873763967762944:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786960813.086771:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960813.086810:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967762944 00000100:00100000:2.0:1786960813.086815:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967762944 00000100:00100000:2.0:1786960813.086854:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960813.086862:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1873763967762944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786960813.087046:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1873763967762944:12345-0@lo:1000:mdt00_001.0 Request processed in 184us (273us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1786960813.087053:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960813.087075:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960813.087095:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1873763967762944:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1786960813.087130:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087142:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087151:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087159:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960813.087164:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087172:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087221:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960813.087225:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960813.087230:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087237:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fad2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087295:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087302:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087307:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087313:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960813.087315:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087321:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087330:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:2.0:1786960813.087333:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960813.087336:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087343:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fa07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087394:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087412:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087421:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087458:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.087475:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 16 pid: 5811 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960813.087490:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967763072:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960813.087703:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673afa000 going to sleep for 11 seconds 00000100:00100000:0.0:1786960813.097441:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960813.098261:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958303616 00000100:00100000:3.0:1786960813.098276:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958303616 00010000:00010000:3.0:1786960813.098330:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 17 pid: 5811 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.098379:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1786960813.098391:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:2344:x1873763958303616:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960813.098410:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960813.098418:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 17 pid: 5811 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098434:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 17 pid: 5811 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098463:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:3.0:1786960813.098469:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098482:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098490:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098513:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960813.098583:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:2344:x1873763958303616:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 194us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960813.098603:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00010000:00010000:3.0:1786960813.098752:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fa23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bf8a expref: 16 pid: 5811 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.098780:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967763072:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960813.098809:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098819:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098825:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098840:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098846:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098853:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098859:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960813.098864:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098872:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098894:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:3.0:1786960813.098897:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960813.098901:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098908:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fad9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098920:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098926:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098932:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098938:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960813.098941:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098948:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098956:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de200) 00010000:00010000:3.0:1786960813.098958:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786960813.098961:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960813.098967:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97facb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960813.100715:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10442:x1873763958303360:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 29110us (30721us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1786960813.100732:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000020:00080000:3.0:1786960813.100739:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786960813.101003:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960813.101009:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960813.101043:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1786960813.101058:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786960813.110306:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960813.110493:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958303872 00000100:00100000:2.0:1786960813.110507:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958303872 00000100:00100000:2.0:1786960813.110580:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1786960813.110591:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10442:x1873763958303872:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1786960813.117519:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1786960813.117649:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1786960813.117741:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117764:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117778:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117789:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117797:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117804:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960813.117874:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786960813.118030:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10442:x1873763958303872:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 7434us (7733us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1786960813.118042:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000020:00080000:0.0:1786960813.118110:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960813.124241:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960813.124262:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.124276:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960813.124281:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.124293:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.124316:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9766559de400) 00010000:00010000:2.0:1786960813.124329:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786960813.124336:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.124343:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fae0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960813.124377:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960813.124379:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960813.124381:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960813.207341:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960813.207414:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960813.207460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960813.207517:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304128 00000100:00100000:1.0:1786960813.207531:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304128 00000100:00100000:3.0:1786960813.207597:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304000 00000100:00100000:3.0:1786960813.207603:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304000 00000100:00100000:3.0:1786960813.207654:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 288 00000100:00100000:3.0:1786960813.207665:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958304000:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960813.207721:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:3.0:1786960813.207756:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958304000:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960813.207763:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958304128:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960813.207771:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 288 00000100:00100000:1.0:1786960813.207814:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958304128:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 61us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960813.207822:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1786960813.208931:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304256 00000100:00080000:2.0:1786960813.208933:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960813.208943:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304256 00000100:00100000:0.0:1786960813.209031:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:0.0:1786960813.209043:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958304256:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:2.0:1786960813.209048:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960813.209122:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958304256:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 83us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960813.209143:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00010000:00010000:3.0:1786960813.300918:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960814.324369:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786960814.878832:0:12021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786960814.878841:0:12021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786960814.878880:0:12021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1786960814.878886:0:12021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1786960814.993627:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1786960814.993649:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1786960815.067729:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.073698:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304512 00000100:00100000:1.0:1786960815.073718:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304512 00000100:00100000:1.0:1786960815.073874:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:1.0:1786960815.073886:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:10461:x1873763958304512:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960815.073911:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960815.073933:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97fae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfc2 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.075408:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97faee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.075425:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97faee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.075438:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97faee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786960815.075442:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1786960815.075450:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1786960815.075638:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97fae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc2 expref: 20 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.075654:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97faee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc2 expref: 19 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.075675:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960815.075678:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786960815.075681:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92600, rc 0) 00000100:00100000:1.0:1786960815.075752:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10461:x1873763958304512:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1868us (8031us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1786960815.075761:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:1.0:1786960815.090345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.092701:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304640 00000100:00100000:0.0:1786960815.092715:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304640 00000100:00100000:0.0:1786960815.092776:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:0.0:1786960815.092786:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10461:x1873763958304640:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1786960815.092858:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.092875:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.092886:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.092902:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.092909:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.092914:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093620:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093630:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093638:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960815.093686:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093700:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093706:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093712:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093718:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960815.093722:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093729:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093741:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960815.093744:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960815.093749:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093755:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fafc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093775:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093781:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093793:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093800:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960815.093803:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093809:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093817:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de500) 00010000:00010000:0.0:1786960815.093819:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960815.093822:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093827:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fb03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093843:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093849:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093855:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093860:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960815.093863:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093878:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093886:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960815.093888:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960815.093891:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.093897:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fb0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960815.093991:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10461:x1873763958304640:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1193us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960815.094000:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:0.0:1786960815.171095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.171894:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958304896 00000100:00100000:1.0:1786960815.171904:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958304896 00000100:00100000:1.0:1786960815.173007:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1786960815.173023:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:10464:x1873763958304896:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960815.173044:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960815.173064:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fb11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfc9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173339:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173353:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173365:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173380:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173388:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173406:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173707:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173716:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173723:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960815.173733:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1786960815.173826:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173834:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173839:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173846:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960815.173850:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173857:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173869:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960815.173872:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960815.173883:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173890:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97fb18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173901:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173907:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173913:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173918:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960815.173921:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173927:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173935:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976661496e00) 00010000:00010000:1.0:1786960815.173938:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960815.173940:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173946:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fb1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.173996:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fb11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.174020:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.174027:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960815.174030:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960815.174032:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92800, rc 0) 00000100:00100000:1.0:1786960815.175041:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10464:x1873763958304896:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2017us (3959us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1786960815.175051:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1786960815.180632:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.180698:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958305024 00000100:00100000:2.0:1786960815.180707:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958305024 00000100:00100000:2.0:1786960815.180767:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:2.0:1786960815.180778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10464:x1873763958305024:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1786960815.180850:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180867:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180878:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180904:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180926:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180933:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180939:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.180943:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180950:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180963:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.180965:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960815.180969:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.180986:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.181062:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10464:x1873763958305024:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 285us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.181070:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1786960815.185073:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.187372:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958305280 00000100:00100000:0.0:1786960815.187392:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958305280 00000100:00100000:1.0:1786960815.187562:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:1.0:1786960815.187575:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10464:x1873763958305280:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960815.187821:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10464:x1873763958305280:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 245us (2758us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1786960815.187830:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1786960815.226533:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.226688:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958305536 00000100:00100000:2.0:1786960815.226697:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958305536 00000100:00100000:2.0:1786960815.226754:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:2.0:1786960815.226763:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:9983:x1873763958305536:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960815.226787:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960815.226817:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfd0 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.226910:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.226924:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.226932:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.226965:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.226989:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 23 pid: 5811 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.227003:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681704700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967763200:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960815.227638:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a81e780 going to sleep for 11 seconds 00000100:00100000:1.0:1786960815.231703:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681704700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967763200:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960815.231734:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.232064:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.232398:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958305664 00000100:00100000:1.0:1786960815.232405:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958305664 00010000:00010000:1.0:1786960815.232442:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 24 pid: 5811 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960815.232483:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1786960815.232508:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:2343:x1873763958305664:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960815.232523:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960815.232531:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 24 pid: 5811 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232544:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 24 pid: 5811 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232566:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fb26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc9 expref: 24 pid: 5811 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232582:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960815.232587:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232596:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232604:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.232636:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960815.232694:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:2343:x1873763958305664:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 188us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960815.232702:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00010000:00010000:2.0:1786960815.232853:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.232861:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960815.232886:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1786960815.233056:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 24 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.233096:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 23 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.233104:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.233107:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786960815.233109:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960815.233160:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:9983:x1873763958305536:12345-192.168.203.23@tcp:101:bash.0 Request processed in 6398us (6636us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1786960815.233167:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:3.0:1786960815.240584:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.240782:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958305920 00000100:00100000:2.0:1786960815.240794:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958305920 00000100:00100000:2.0:1786960815.240858:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1786960815.240869:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:9983:x1873763958305920:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:2.0:1786960815.241146:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.241162:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.241172:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960815.241257:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1786960815.241290:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007140c5b8 reply state 000000002451a881 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.241299:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1786960815.241366:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1786960815.241479:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:9983:x1873763958305920:12345-192.168.203.23@tcp:36:bash.0 Request processed in 610us (908us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1786960815.241486:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000020:00080000:2.0:1786960815.241490:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1786960815.249790:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.250015:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306048 00000100:00100000:0.0:1786960815.250024:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306048 00010000:00010000:3.0:1786960815.250090:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250105:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250130:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250136:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960815.250141:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250149:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250165:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:3.0:1786960815.250168:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960815.250172:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.250178:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fb50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.250448:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:2.0:1786960815.250464:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:9983:x1873763958306048:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960815.250489:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960815.250507:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fb57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfd7 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.250564:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fb57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd7 expref: 27 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.250579:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fb57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd7 expref: 27 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.250608:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.250611:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960815.250614:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ec00, rc 0) 00000100:00100000:2.0:1786960815.250678:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:9983:x1873763958306048:12345-192.168.203.23@tcp:101:bash.0 Request processed in 219us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.250686:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:0.0:1786960815.253963:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.254031:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306176 00000100:00100000:3.0:1786960815.254041:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306176 00000100:00100000:3.0:1786960815.254113:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1786960815.254124:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:9983:x1873763958306176:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960815.254140:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960815.254160:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfde expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960815.254216:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a82dbab, atime: 0x6a82dba9, ctime: 0x6a82dbab, blocks: 0xb 00010000:00010000:3.0:1786960815.254238:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:3.0:1786960815.254243:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960815.254261:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.254280:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.254292:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ac00, rc 0) 00000100:00100000:3.0:1786960815.254339:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:9983:x1873763958306176:12345-192.168.203.23@tcp:101:bash.0 Request processed in 217us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.254346:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00080000:2.0:1786960815.254552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960815.257108:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.257415:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306304 00000100:00100000:0.0:1786960815.257424:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306304 00002000:00010000:0.0:1786960815.257456:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1786960815.257460:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766770f0a80 with x1873763958306304 ext(0->18446744073709551615) 00002000:00010000:0.0:1786960815.257471:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766770f0a80. 00000100:00100000:0.0:1786960815.257494:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960815.257502:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958306304:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:0.0:1786960815.257765:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1786960815.257780:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1786960811 -> 1786960815 00002000:00010000:0.0:1786960815.257783:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1786960809 -> 1786960809 00002000:00010000:0.0:1786960815.257785:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1786960811 -> 1786960815 00002000:00010000:0.0:1786960815.257787:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1786960815.257836:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958306304:12345-192.168.203.23@tcp:10:bash.0 Request processed in 334us (735us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1786960815.257843:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00010000:0.0:1786960815.257847:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1786960815.257849:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766770f0a80 with x1873763958306304 ext(0->18446744073709551615) 00002000:00010000:0.0:1786960815.257854:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766770f0a80. 00010000:00010000:3.0:1786960815.351169:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960815.359871:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.359986:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306432 00000100:00100000:2.0:1786960815.359997:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306432 00000100:00100000:2.0:1786960815.360059:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:2.0:1786960815.360070:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10478:x1873763958306432:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1786960815.360168:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360222:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360235:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360253:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360260:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360267:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360566:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360575:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360582:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960815.360621:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360632:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360647:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360653:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360659:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.360662:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360669:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360681:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960815.360684:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.360688:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360694:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360707:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360713:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360718:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360723:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.360733:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360739:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360747:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976664f8ca00) 00010000:00010000:2.0:1786960815.360750:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.360752:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360758:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360770:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360776:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360782:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360786:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.360789:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360795:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360802:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.360804:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.360813:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.360818:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.360899:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10478:x1873763958306432:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 830us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.360907:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 91 00000100:00100000:1.0:1786960815.424179:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.424545:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306688 00000100:00100000:2.0:1786960815.424554:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306688 00000100:00100000:2.0:1786960815.424605:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:2.0:1786960815.424631:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:10481:x1873763958306688:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960815.424652:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960815.424674:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfe5 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424749:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424762:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424772:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424787:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424794:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.424819:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425143:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fb8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425153:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425161:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fb8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960815.425170:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1786960815.425287:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425295:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425302:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425308:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.425312:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425319:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425331:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960815.425334:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.425345:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425351:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fb81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425363:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425369:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425375:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425380:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.425383:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425389:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425395:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976664f8ca00) 00010000:00010000:2.0:1786960815.425397:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.425400:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425405:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fb88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425440:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfe5 expref: 30 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425463:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fb8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfe5 expref: 29 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.425470:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.425473:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786960815.425475:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ea00, rc 0) 00000100:00100000:2.0:1786960815.425536:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10481:x1873763958306688:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 907us (1366us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1786960815.425543:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:3.0:1786960815.431660:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.431755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958306816 00000100:00100000:2.0:1786960815.431764:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958306816 00000100:00100000:2.0:1786960815.431824:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:2.0:1786960815.431835:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10481:x1873763958306816:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1786960815.431902:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.431919:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 29 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.431928:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.431962:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 29 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.431987:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 29 pid: 8734 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.432015:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681707100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967763328:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960815.432109:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efc180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960815.438112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.438277:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958307072 00000100:00100000:0.0:1786960815.438288:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958307072 00000100:00100000:0.0:1786960815.438343:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1786960815.438353:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:5580:x1873763958307072:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786960815.438666:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:5580:x1873763958307072:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 313us (561us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1786960815.438674:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1786960815.438824:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681707100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967763328:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960815.438849:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960815.440518:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.440724:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958307200 00000100:00100000:3.0:1786960815.440732:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958307200 00010000:00010000:3.0:1786960815.440766:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 31 pid: 8734 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.440803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1786960815.440812:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:2344:x1873763958307200:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960815.440825:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960815.440831:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 31 pid: 8734 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.440843:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 31 pid: 8734 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.440880:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fb42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd0 expref: 31 pid: 8734 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.440895:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:3.0:1786960815.440900:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.440909:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.440915:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.441018:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960815.442308:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:2344:x1873763958307200:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1492us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.442319:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00010000:00010000:2.0:1786960815.442475:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442484:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442516:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442524:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442529:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442535:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.442539:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442546:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442559:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.442573:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960815.442579:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.442585:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fb9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960815.442639:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10481:x1873763958306816:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 10806us (10988us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.442648:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:0.0:1786960815.448894:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.452233:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958307456 00000100:00100000:1.0:1786960815.452248:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958307456 00000100:00100000:1.0:1786960815.452323:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1786960815.452334:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:10481:x1873763958307456:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960815.452577:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10481:x1873763958307456:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 244us (3693us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1786960815.452585:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:3.0:1786960815.541166:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960815.547435:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958307712 00000100:00100000:2.0:1786960815.547449:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958307712 00000100:00100000:2.0:1786960815.547555:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:2.0:1786960815.547565:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:10492:x1873763958307712:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1786960815.547589:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960815.547609:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fba4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bfec expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547675:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547689:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547700:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547724:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547731:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.547749:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549498:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549515:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549526:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960815.549537:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1786960815.549618:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549626:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549633:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549639:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.549643:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549651:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549661:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960815.549664:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.549675:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549682:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fbab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549694:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549700:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549706:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549711:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.549714:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549720:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549726:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976664f8ca00) 00010000:00010000:2.0:1786960815.549728:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960815.549731:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.549737:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fbb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.553378:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fba4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfec expref: 33 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.553429:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfec expref: 32 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.553439:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960815.553442:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960815.553445:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f000, rc 0) 00000100:00100000:2.0:1786960815.553525:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10492:x1873763958307712:12345-192.168.203.23@tcp:101:cat.0 Request processed in 5960us (12366us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1786960815.553534:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1786960815.561556:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.563543:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958307968 00000100:00100000:1.0:1786960815.563554:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958307968 00000100:00100000:1.0:1786960815.563623:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1786960815.563633:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10492:x1873763958307968:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:1.0:1786960815.563871:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10492:x1873763958307968:12345-192.168.203.23@tcp:35:cat.0 Request processed in 238us (2323us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1786960815.563878:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1786960815.614284:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.619429:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958308224 00000100:00100000:1.0:1786960815.619445:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958308224 00000100:00100000:1.0:1786960815.619578:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:1.0:1786960815.619590:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10493:x1873763958308224:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:1.0:1786960815.619649:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786960815.619676:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fbb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfec expref: 33 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619701:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fb8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfe5 expref: 32 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619716:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fb57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfd7 expref: 31 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619741:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960815.619751:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960815.619785:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619798:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619808:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619835:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619843:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.619850:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.621664:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.621680:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.621690:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960815.625661:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1786960815.625676:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 297652488944ns, next at 298652485073ns, rc = 0 00010000:00010000:1.0:1786960815.625775:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625795:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625806:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625815:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625836:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625843:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625865:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960815.625887:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.625895:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960815.625895:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625907:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.625908:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625921:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960815.625924:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960815.625927:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.625930:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.625942:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.625945:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626871:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496300) 00010000:00010000:1.0:1786960815.626876:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786960815.626881:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626889:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626910:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626917:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626924:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626930:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960815.626934:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626940:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626948:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:1.0:1786960815.626950:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960815.626953:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.626959:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960815.626996:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1cef55e reply state 000000007f20bf00 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960815.627006:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786960815.627071:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff976661496300) 00010000:00010000:2.0:1786960815.627076:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786960815.627080:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.627088:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fbdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.627112:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960815.627215:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960815.627219:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960815.627943:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:10493:x1873763958308224:12345-192.168.203.23@tcp:36:rm.0 Request processed in 8350us (13661us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1786960815.627955:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00010000:00010000:3.0:1786960815.630495:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630511:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630519:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630537:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960815.630541:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630549:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630565:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976661496e00) 00010000:00010000:3.0:1786960815.630568:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960815.630572:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.630579:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fbce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.686328:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.687108:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958308480 00000100:00100000:1.0:1786960815.687121:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958308480 00000100:00100000:1.0:1786960815.687225:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:1.0:1786960815.687238:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:10499:x1873763958308480:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960815.687261:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960815.687282:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbe3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bff3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687410:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687426:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687438:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687454:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687461:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.687484:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786960815.689423:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1786960815.689629:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689645:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689655:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689695:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689703:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689721:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689728:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960815.689732:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689740:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.689753:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:3.0:1786960815.690593:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960815.690601:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.690609:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fbea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960815.690628:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a13babfc reply state 000000003a87055b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.690638:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786960815.690679:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97fbe3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.690695:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.690703:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960815.690706:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960815.690717:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a000, rc 0) 00000100:00100000:3.0:1786960815.691353:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:10499:x1873763958308480:12345-192.168.203.23@tcp:101:bash.0 Request processed in 4115us (5031us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1786960815.691363:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00010000:00010000:3.0:1786960815.695105:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695130:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695138:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695144:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960815.695148:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695157:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695174:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976661496d00) 00010000:00010000:3.0:1786960815.695178:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960815.695183:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.695219:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97fbf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.698051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960815.698144:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958308608 00000100:00100000:1.0:1786960815.698153:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958308608 00000100:00100000:1.0:1786960815.698241:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1786960815.698251:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958308608:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960815.698268:0:8239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960815.698287:0:8239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790bffa expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960815.698312:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960815.698330:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=297s v=(0 0) 00010000:00010000:1.0:1786960815.698335:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960815.698344:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 6 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.698361:0:8239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 6 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960815.698374:0:8239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92200, rc 0) 00000100:00100000:1.0:1786960815.698431:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958308608:12345-192.168.203.23@tcp:101:bash.0 Request processed in 181us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960815.698438:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00080000:2.0:1786960815.698507:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960815.712909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.713095:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958308736 00000100:00100000:3.0:1786960815.713104:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958308736 00000100:00100000:3.0:1786960815.713167:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1786960815.713175:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:10499:x1873763958308736:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960815.713225:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960815.713242:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c001 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.713271:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.713281:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960815.713285:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960815.713290:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.713332:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.713345:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.713359:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967763456:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960815.713436:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960815.721610:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad30e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967763456:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960815.721647:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.721688:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b400, rc 0) 00000100:00100000:3.0:1786960815.721747:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:10499:x1873763958308736:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8571us (8845us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.721866:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:1.0:1786960815.732964:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.736752:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958308864 00000100:00100000:3.0:1786960815.737069:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958308864 00010000:00010000:3.0:1786960815.740618:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.740674:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960815.740685:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958308864:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960815.740700:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960815.740723:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.740737:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.740768:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021adc8af/0x1808d16e4c97fc06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bffa expref: 7 pid: 8239 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.740784:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960815.740789:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960815.740797:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.740826:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.740866:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.740881:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad30e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967763584:192.168.203.23@tcp:105: 00000100:00100000:3.0:1786960815.740984:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960815.756310:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.756502:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad30e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967763584:192.168.203.23@tcp:105: 00010000:00010000:3.0:1786960815.756526:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960815.756588:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958308864:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 15904us (23632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.756600:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1786960815.756712:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958309120 00000100:00100000:1.0:1786960815.756725:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958309120 00000100:00100000:1.0:1786960815.756775:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1786960815.756784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:10499:x1873763958309120:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1786960815.757332:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:10499:x1873763958309120:12345-192.168.203.23@tcp:35:bash.0 Request processed in 548us (1031us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1786960815.757339:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1786960815.925168:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960815.925309:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960815.925331:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967764096:0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925399:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960815.925480:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967763968:0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925505:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960815.925526:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786960815.925531:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967763840:0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925552:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960815.925586:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967763968 00000100:00100000:3.0:1786960815.925593:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967763968 00000100:00100000:3.0:1786960815.925639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967763840 00000100:00100000:3.0:1786960815.925655:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967763840 00000100:00100000:3.0:1786960815.925675:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1786960815.925683:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967763968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925726:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967763968:12345-0@lo:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.925733:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1786960815.925748:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786960815.925754:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967763840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925777:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967763840:12345-0@lo:400:kworker.0 Request processed in 23us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.925782:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786960815.925814:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967763840:0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925822:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967763968:0@lo:400:kworker.0 00000100:00080000:3.0:1786960815.925851:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960815.925872:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764096 00000100:00100000:3.0:1786960815.925875:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764096 00000100:00100000:3.0:1786960815.925902:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786960815.925909:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967764096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.925938:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967764096:12345-0@lo:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.925943:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1786960815.925958:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960815.925983:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967764096:0@lo:400:kworker.0 00000100:00100000:2.0:1786960815.927209:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967763712:0@lo:400:kworker.0 00000100:00100000:2.0:1786960815.927257:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960815.927290:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960815.927299:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967764224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960815.927324:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960815.927351:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764224 00000100:00100000:2.0:1786960815.927356:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764224 00000100:00100000:2.0:1786960815.927390:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960815.927397:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967764224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960815.927425:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960815.927463:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967764224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.927469:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786960815.927507:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967764224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960815.927536:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967763712 00000100:00100000:2.0:1786960815.927551:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967763712 00000100:00100000:2.0:1786960815.927579:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786960815.927586:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967763712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960815.927617:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967763712:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960815.927624:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786960815.927653:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967763712:0@lo:400:kworker.0 00000100:00100000:1.0:1786960815.930932:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960815.930954:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967764352:0@lo:400:kworker.0 00000100:00100000:1.0:1786960815.931251:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960815.931361:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967764480:0@lo:400:kworker.0 00000100:00100000:1.0:1786960815.931388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960815.931444:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764480 00000100:00100000:1.0:1786960815.931451:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764480 00000100:00100000:1.0:1786960815.931504:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786960815.931513:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967764480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960815.931925:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967764480:12345-0@lo:400:kworker.0 Request processed in 411us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960815.931933:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1786960815.931978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960815.932003:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1786960815.932468:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1786960815.932489:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766597a5180, transno 4294967301 00000100:00100000:1.0:1786960815.932505:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967764480:0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.939171:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764352 00000100:00100000:3.0:1786960815.939200:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764352 00000100:00100000:3.0:1786960815.939287:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1786960815.939308:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967764352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960815.939398:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967764352:12345-0@lo:400:kworker.0 Request processed in 91us (8147us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.939405:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1786960815.939650:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960815.939784:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967764352:0@lo:400:kworker.0 00000100:00100000:1.0:1786960815.939845:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.940066:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958309248 00000100:00100000:3.0:1786960815.940071:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958309248 00000100:00100000:3.0:1786960815.940147:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:3.0:1786960815.940156:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:10515:x1873763958309248:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960815.940173:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960815.940215:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97fc14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c008 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940279:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940292:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940303:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960815.940358:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1786960815.940362:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960815.940381:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940404:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169be00/0x1808d16e4c97fc14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c008 expref: 36 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940423:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c008 expref: 35 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.940440:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:3.0:1786960815.940444:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960815.940447:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b600, rc 0) 00000100:00100000:3.0:1786960815.940491:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:10515:x1873763958309248:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 336us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.940498:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:0.0:1786960815.945956:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.946141:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958309504 00000100:00100000:3.0:1786960815.946151:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958309504 00000100:00100000:3.0:1786960815.946227:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:3.0:1786960815.946238:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:10515:x1873763958309504:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960815.946258:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960815.946279:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c00f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.946377:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fc29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.946393:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fc29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.946404:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fc29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960815.946417:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1786960815.946534:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c00f expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.946645:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fc29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c00f expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.946654:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960815.946657:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960815.946660:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:3.0:1786960815.946773:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:10515:x1873763958309504:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 536us (825us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1786960815.946781:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:0.0:1786960815.961387:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.961430:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.961502:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958309632 00000100:00100000:3.0:1786960815.961512:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958309632 00000100:00100000:3.0:1786960815.961578:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1786960815.961588:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:2344:x1873763958309632:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960815.961604:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960815.961628:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fc29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c00f expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.961644:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960815.961648:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960815.961708:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:2344:x1873763958309632:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 122us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960815.961715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1786960815.962787:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958309888 00000100:00100000:2.0:1786960815.962808:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958309888 00000100:00100000:2.0:1786960815.962867:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:2.0:1786960815.962876:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:10515:x1873763958309888:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960815.962899:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960815.962918:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fc37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c016 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.963241:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.963256:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.963267:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960815.963278:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1786960815.963395:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97fc37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c016 expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.963412:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c016 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960815.963420:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960815.963423:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786960815.963426:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e800, rc 0) 00000100:00100000:2.0:1786960815.963655:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:10515:x1873763958309888:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 779us (2224us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1786960815.963663:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:0.0:1786960815.976904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960815.977418:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310016 00000100:00100000:3.0:1786960815.977431:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310016 00000100:00100000:3.0:1786960815.977490:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:3.0:1786960815.977507:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958310016:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:3.0:1786960815.977565:0:8239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.977583:0:8239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.977600:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1786960815.977605:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960815.977609:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.977644:0:8239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960815.977658:0:8239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 6 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960815.977673:0:8239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8239:1873763967764608:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960815.977743:0:8239:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96900 going to sleep for 11 seconds 00000100:00100000:1.0:1786960815.996119:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960815.997470:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310144 00000100:00100000:0.0:1786960815.997483:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310144 00002000:00100000:0.0:1786960815.997547:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97664e74ed80 x1873763958310144/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:401/0 lens 504/0 e 0 to 0 dl 1786960826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960815.997559:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97664e74ed80 with x1873763958310144 ext(0->8) 00010000:00010000:0.0:1786960815.997569:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 7 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.997594:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 7 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960815.997602:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97664e74ed80 00000100:00100000:0.0:1786960815.997643:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960815.997653:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958310144:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:0.0:1786960815.999162:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2344:x1873763958310144:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 1505us (3048us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1786960815.999173:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00100000:0.0:1786960815.999182:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97664e74ed80 x1873763958310144/t4294967302(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:401/0 lens 504/448 e 0 to 0 dl 1786960826 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960815.999216:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97664e74ed80 with x1873763958310144 ext(0->8) 00010000:00010000:0.0:1786960815.999225:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960815.999239:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960815.999258:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97664e74ed80 00000100:00100000:3.0:1786960816.004079:0:8239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8239:1873763967764608:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960816.004108:0:8239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.004479:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.004557:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310272 00000100:00100000:0.0:1786960816.004565:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310272 00010000:00010000:0.0:1786960816.004601:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.004641:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:0.0:1786960816.004652:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2344:x1873763958310272:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960816.004667:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786960816.004685:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1786960816.004687:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786960816 00002000:00010000:0.0:1786960816.004689:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786960816 00002000:00010000:0.0:1786960816.004692:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786960816 00010000:00010000:0.0:1786960816.004698:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.004710:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.004734:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086fbf9d/0x1808d16e4c97fc0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c001 expref: 9 pid: 6658 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.004751:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960816.004756:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960816.004761:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.004783:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.004815:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960816.006021:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958310272:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1363us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960816.006032:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00010000:00010000:1.0:1786960816.008237:0:8239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008254:0:8239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008287:0:8239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008295:0:8239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008304:0:8239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008311:0:8239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960816.008315:0:8239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008324:0:8239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008342:0:8239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.008350:0:8239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d80a46a/0x1808d16e4c97fc4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.008446:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958310016:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 30938us (31550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960816.008456:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1786960816.014677:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.014837:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310528 00000100:00100000:0.0:1786960816.014847:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310528 00000100:00100000:0.0:1786960816.014901:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:0.0:1786960816.014911:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:10515:x1873763958310528:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:0.0:1786960816.015373:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c016 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960816.015726:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1786960816.015772:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1786960816.016826:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1786960816.016891:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.016909:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.016917:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.016951:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.016997:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 42 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.017011:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967764736:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960816.017285:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786960816.021685:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.021760:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310656 00000100:00100000:3.0:1786960816.021769:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310656 00010000:00010000:3.0:1786960816.021819:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 43 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960816.021863:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1786960816.021873:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+43:2343:x1873763958310656:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960816.021888:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960816.021894:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 43 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.021908:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 43 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.021928:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960816.021933:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.021942:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.021950:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.021986:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960816.022039:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+43:2343:x1873763958310656:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 167us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.022046:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00010000:00010000:0.0:1786960816.024647:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c97fbf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bff3 expref: 42 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.024672:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967764736:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960816.024695:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.024704:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.024709:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960816.024833:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1786960816.026448:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1786960816.026601:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967764864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786960816.026656:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960816.026697:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abd180 going to sleep for 11 seconds 00000100:00100000:2.0:1786960816.027301:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764864 00000100:00100000:2.0:1786960816.027310:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764864 00000100:00100000:2.0:1786960816.027363:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960816.027372:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967764864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960816.027454:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967764864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960816.027461:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786960816.027649:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967764864:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786960816.028082:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1786960816.029128:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967764992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786960816.029175:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960816.029318:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681bafe40 going to sleep for 11 seconds 00000100:00100000:2.0:1786960816.029434:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967764992 00000100:00100000:2.0:1786960816.029440:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967764992 00000100:00100000:2.0:1786960816.029473:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960816.029482:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967764992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960816.029654:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1873763967764992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 172us (477us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1786960816.029661:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786960816.029804:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967764992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1786960816.029859:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1786960816.029900:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.029911:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.029920:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.029926:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960816.029931:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.029940:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.030050:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:1.0:1786960816.030053:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786960816.030058:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.030065:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786960816.030522:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786960816.030604:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1786960816.030614:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 298057426934ns, next at 299057424560ns, rc = 0 00000001:00080000:1.0:1786960816.030621:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1786960816.030656:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01a00) 00010000:00010000:1.0:1786960816.030659:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786960816.030668:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fc3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c016 expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.030805:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+45:10515:x1873763958310528:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 15895us (16137us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1786960816.030814:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000020:00080000:1.0:1786960816.030818:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1786960816.039664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.039714:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958310784 00000100:00100000:3.0:1786960816.039723:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958310784 00000100:00100000:3.0:1786960816.039783:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1786960816.039808:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+45:10515:x1873763958310784:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960816.039834:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960816.039856:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c01d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.039915:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c01d expref: 46 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.039931:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c01d expref: 46 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.039951:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.039954:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960816.039958:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044800, rc 0) 00000100:00100000:3.0:1786960816.040027:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:10515:x1873763958310784:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 221us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.040035:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:0.0:1786960816.047466:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.047939:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958311040 00000100:00100000:3.0:1786960816.047949:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958311040 00000100:00100000:3.0:1786960816.048024:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1786960816.048036:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:10515:x1873763958311040:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960816.048731:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:10515:x1873763958311040:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 694us (1270us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1786960816.048741:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1786960816.171557:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.171745:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958311168 00000100:00100000:3.0:1786960816.171816:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958311168 00000100:00100000:3.0:1786960816.171918:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:3.0:1786960816.171928:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:10525:x1873763958311168:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:3.0:1786960816.172012:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172041:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172053:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172070:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172077:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172084:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172178:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172229:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172238:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960816.172279:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172292:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172298:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172315:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172320:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960816.172324:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172331:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172343:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:3.0:1786960816.172346:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960816.172350:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172355:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fc61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172368:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172373:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172378:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172383:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960816.172386:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172400:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172407:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976643e01400) 00010000:00010000:3.0:1786960816.172409:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960816.172412:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172417:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fc68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172430:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172435:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172439:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172444:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960816.172446:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172451:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172458:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.172461:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960816.172464:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.172480:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fc6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960816.172546:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:10525:x1873763958311168:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 618us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.172553:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:1.0:1786960816.213867:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.213984:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958311424 00000100:00100000:0.0:1786960816.213993:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958311424 00000100:00100000:0.0:1786960816.214053:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:0.0:1786960816.214152:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:10528:x1873763958311424:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960816.214173:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960816.214226:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fc76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c024 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214300:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214315:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214326:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214341:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214348:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214354:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214476:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214485:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214493:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960816.214529:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786960816.214623:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214631:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214638:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214645:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960816.214649:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214657:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214670:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960816.214673:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960816.214677:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214684:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fc7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214702:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214708:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214724:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214730:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960816.214733:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214740:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214748:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de100) 00010000:00010000:0.0:1786960816.214750:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960816.214753:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214759:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fc84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214807:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fc76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214823:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.214830:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960816.214832:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960816.214834:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1800, rc 0) 00000100:00100000:0.0:1786960816.214897:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:10528:x1873763958311424:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 750us (1038us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1786960816.214913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:1.0:1786960816.217631:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.217793:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958311552 00000100:00100000:0.0:1786960816.217803:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958311552 00000100:00100000:0.0:1786960816.217856:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:0.0:1786960816.217866:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:10528:x1873763958311552:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1786960816.217927:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.217941:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.217951:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.217986:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.217993:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.218000:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.218006:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960816.218010:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.218018:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.218029:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960816.218044:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960816.218048:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.218053:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fc99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.218133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:10528:x1873763958311552:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 268us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960816.218142:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:2.0:1786960816.227925:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960816.228028:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958311808 00000100:00100000:1.0:1786960816.228037:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958311808 00000100:00100000:1.0:1786960816.228095:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1786960816.228105:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:10528:x1873763958311808:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960816.228367:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:10528:x1873763958311808:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 263us (451us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1786960816.228386:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1786960816.301312:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.301543:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312064 00000100:00100000:0.0:1786960816.301553:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312064 00000100:00100000:0.0:1786960816.301620:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:0.0:1786960816.301629:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:10538:x1873763958312064:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960816.301651:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960816.301654:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786960816.301680:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c97fc1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c008 expref: 50 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301701:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960816.301705:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960816.301720:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fca0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c02b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301810:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301822:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301846:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301874:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.301886:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 50 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.301899:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e527100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967765120:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960816.301999:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abd900 going to sleep for 11 seconds 00000100:00100000:3.0:1786960816.307945:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e527100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967765120:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960816.307986:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.308935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.308998:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312192 00000100:00100000:3.0:1786960816.309004:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312192 00010000:00010000:3.0:1786960816.309040:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 51 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960816.309078:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1786960816.309087:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:2344:x1873763958312192:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960816.309100:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960816.309108:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 51 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309129:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 51 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309153:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fc8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c024 expref: 51 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309228:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.309233:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309243:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309251:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.309273:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960816.309323:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:2344:x1873763958312192:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 237us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.309331:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00010000:00010000:1.0:1786960816.309679:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.309687:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960816.309704:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1786960816.309849:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fca0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.309865:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.309873:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:1.0:1786960816.309876:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786960816.309879:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:1.0:1786960816.309920:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:10538:x1873763958312064:12345-192.168.203.23@tcp:101:bash.0 Request processed in 8292us (8617us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1786960816.309928:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 104 00000100:00100000:1.0:1786960816.318379:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.318801:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312448 00000100:00100000:0.0:1786960816.318810:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312448 00000100:00100000:0.0:1786960816.318870:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:0.0:1786960816.318880:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:10538:x1873763958312448:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1786960816.319154:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.319170:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.319182:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960816.319258:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1786960816.319282:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b6caec7 reply state 00000000162522cd transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960816.319309:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960816.319404:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:10538:x1873763958312448:12345-192.168.203.23@tcp:36:bash.0 Request processed in 524us (1032us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1786960816.319873:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000020:00080000:0.0:1786960816.319880:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786960816.321343:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321355:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321363:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321369:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960816.321373:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321381:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321420:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.321423:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960816.321428:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.321435:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fcb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.322873:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.323147:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312576 00000100:00100000:3.0:1786960816.323155:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312576 00000100:00100000:1.0:1786960816.323301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:1.0:1786960816.323312:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:10538:x1873763958312576:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960816.323334:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960816.323363:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fcbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c032 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.323450:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.323464:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.323472:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.323502:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.323515:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 53 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.323527:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967765248:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960816.323617:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6ef600 going to sleep for 11 seconds 00000100:00100000:1.0:1786960816.326000:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967765248:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960816.326028:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.327817:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.333297:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312704 00000100:00100000:3.0:1786960816.333311:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312704 00010000:00010000:3.0:1786960816.333354:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 54 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960816.333449:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:3.0:1786960816.333459:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:2343:x1873763958312704:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960816.333473:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960816.333480:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 54 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333492:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 54 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333514:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fca7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c02b expref: 54 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333532:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.333550:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333560:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333567:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.333612:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960816.333670:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:2343:x1873763958312704:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 212us (5859us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.333678:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00010000:00010000:0.0:1786960816.336367:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.336382:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960816.336434:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786960816.336438:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960816.336457:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.336498:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fcbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.336517:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960816.336526:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960816.336529:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960816.336533:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93600, rc 0) 00000100:00100000:0.0:1786960816.336624:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:10538:x1873763958312576:12345-192.168.203.23@tcp:101:bash.0 Request processed in 13313us (13756us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960816.336632:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 106 00000100:00100000:1.0:1786960816.343714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960816.343804:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958312960 00000100:00100000:0.0:1786960816.343815:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958312960 00000100:00100000:0.0:1786960816.343873:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1786960816.343882:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:10538:x1873763958312960:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:0.0:1786960816.344138:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:10538:x1873763958312960:12345-192.168.203.23@tcp:35:bash.0 Request processed in 257us (433us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1786960816.344147:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00010000:00010000:3.0:1786960816.373340:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960816.394931:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.395022:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313088 00000100:00100000:3.0:1786960816.395033:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313088 00000100:00100000:3.0:1786960816.395093:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:3.0:1786960816.395104:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:10544:x1873763958313088:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960816.395126:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960816.395147:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fcca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c039 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395252:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395266:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395276:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960816.395355:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1786960816.395359:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960816.395381:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395405:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fcca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c039 expref: 55 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395421:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c039 expref: 54 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.395429:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:3.0:1786960816.395431:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960816.395435:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:3.0:1786960816.395486:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958313088:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 384us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.395492:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 107 00000100:00100000:3.0:1786960816.405089:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960816.405270:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313216 00000100:00100000:2.0:1786960816.405280:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313216 00000100:00100000:2.0:1786960816.405339:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:2.0:1786960816.405349:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958313216:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960816.405369:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960816.405402:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fcd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c040 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405460:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405474:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405485:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405498:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405505:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405512:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405605:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405614:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405620:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960816.405654:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786960816.405658:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960816.405675:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405694:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405703:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405710:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405717:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405723:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fe00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960816.405727:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405734:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405745:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960816.405748:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960816.405752:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405759:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fcdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405772:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405778:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405789:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405794:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960816.405797:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405804:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405812:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff976664f8ca00) 00010000:00010000:2.0:1786960816.405814:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960816.405817:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405822:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fce6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405852:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c97fcd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c040 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405865:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c040 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.405872:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960816.405874:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960816.405876:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e000, rc 0) 00000100:00100000:2.0:1786960816.405941:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10544:x1873763958313216:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 593us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960816.405959:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 108 00000100:00100000:1.0:1786960816.409163:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.409521:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313344 00000100:00100000:3.0:1786960816.409531:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313344 00000100:00100000:3.0:1786960816.409603:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1786960816.409614:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:2343:x1873763958313344:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960816.409630:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960816.409655:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c97fced lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c040 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.409672:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.409690:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960816.409747:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:2343:x1873763958313344:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 135us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.409755:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960816.420749:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.422435:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313600 00000100:00100000:3.0:1786960816.422448:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313600 00000100:00100000:3.0:1786960816.422512:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1786960816.422523:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958313600:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960816.422542:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960816.422564:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fcf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c047 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.422663:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.422679:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.422687:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.422718:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.422731:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 55 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960816.422743:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967765376:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960816.422852:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960816.427525:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad33480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967765376:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960816.427552:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960816.428830:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960816.430330:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313728 00000100:00100000:1.0:1786960816.430342:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313728 00010000:00010000:1.0:1786960816.430399:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 56 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960816.430449:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:1.0:1786960816.430459:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:2343:x1873763958313728:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960816.430474:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960816.430481:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 56 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430494:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 56 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430518:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fcc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c032 expref: 56 pid: 5811 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430535:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:1.0:1786960816.430540:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430550:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430558:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.430591:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960816.430931:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:2343:x1873763958313728:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 471us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960816.430940:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00010000:00010000:2.0:1786960816.431069:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.431077:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960816.431097:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786960816.431302:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97fcf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 56 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.431318:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 55 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.431325:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960816.431328:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786960816.431331:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:2.0:1786960816.431356:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10544:x1873763958313600:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 8836us (10617us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1786960816.431363:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 109 00000100:00100000:3.0:1786960816.437125:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967765504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960816.437222:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960816.437270:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967765504 00000100:00100000:3.0:1786960816.437277:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967765504 00000100:00100000:3.0:1786960816.437319:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786960816.437328:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967765504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960816.437347:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960816.437388:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967765504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.437394:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1786960816.437452:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967765504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960816.441794:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960816.441867:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958313984 00000100:00100000:3.0:1786960816.441877:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958313984 00000100:00100000:3.0:1786960816.441940:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1786960816.441951:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10544:x1873763958313984:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1786960816.441965:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960816.441998:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fc5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c01d expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960816.442017:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:3.0:1786960816.442021:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960816.442084:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958313984:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960816.442092:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1786960816.444582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960816.444741:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314112 00000100:00100000:2.0:1786960816.444750:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314112 00000100:00100000:2.0:1786960816.444804:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1786960816.444815:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958314112:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:2.0:1786960816.444927:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.444942:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960816.444953:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786960816.445146:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1786960816.445361:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958314112:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 547us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960816.445369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 110 00000100:00100000:2.0:1786960816.447501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960816.447724:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314240 00000100:00100000:1.0:1786960816.447733:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314240 00000100:00100000:1.0:1786960816.447819:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 111 00000100:00100000:1.0:1786960816.447830:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:10544:x1873763958314240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960816.447848:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960816.447865:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c04e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447917:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447927:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447944:0:5810:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447954:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447980:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:1.0:1786960816.447983:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786960816.447987:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960816.447995:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93600, rc 0) 00000100:00100000:1.0:1786960816.448046:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10544:x1873763958314240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 219us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960816.448053:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 111 00000040:00080000:0.0:1786960817.204388:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960817.204410:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960817.204469:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1786960817.204477:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786960817.204608:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967765632:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786960817.204931:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960817.212005:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.212074:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314368 00000100:00100000:1.0:1786960817.212083:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314368 00000100:00100000:1.0:1786960817.212174:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1786960817.212216:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958314368:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786960817.212250:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786960817.212369:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958314368:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 186us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960817.212378:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1786960817.212436:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967765632:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1786960817.212682:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960817.226119:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.226243:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314496 00000100:00100000:2.0:1786960817.226254:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314496 00000100:00100000:2.0:1786960817.226317:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:2.0:1786960817.226327:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10546:x1873763958314496:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786960817.226398:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226414:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226427:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226489:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226511:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226518:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226548:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226557:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226563:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960817.226601:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786960817.226605:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960817.226617:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226627:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226634:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226641:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226647:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960817.226650:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226666:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226679:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:2.0:1786960817.226682:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960817.226687:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226693:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226720:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226727:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226733:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226737:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960817.226740:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226746:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226752:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff976664f8ca00) 00010000:00010000:2.0:1786960817.226754:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960817.226757:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226771:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd1e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226785:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226791:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226796:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226801:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960817.226803:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226809:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226816:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960817.226818:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960817.226821:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.226826:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.227086:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10546:x1873763958314496:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 757us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960817.227096:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1786960817.232603:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.232762:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314752 00000100:00100000:1.0:1786960817.232773:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314752 00000100:00100000:1.0:1786960817.232832:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:1.0:1786960817.232841:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:10546:x1873763958314752:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960817.232861:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960817.232881:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97fd2c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c055 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233003:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233018:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233030:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960817.233042:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1786960817.233348:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233369:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233376:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233382:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960817.233387:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233394:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233406:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:1.0:1786960817.233409:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786960817.233413:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233420:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97fd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233463:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97fd2c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c055 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233472:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:1.0:1786960817.233474:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786960817.233479:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97fd2c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c055 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.233488:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92c00, rc 0) 00000100:00100000:1.0:1786960817.233593:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958314752:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 751us (996us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1786960817.233601:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1786960817.245811:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.246880:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958314880 00000100:00100000:1.0:1786960817.246891:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958314880 00000100:00100000:1.0:1786960817.247083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:1.0:1786960817.247094:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958314880:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786960817.247142:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786960817.247285:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958314880:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 193us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960817.247293:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:3.0:1786960817.264097:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.264717:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958315136 00000100:00100000:2.0:1786960817.264726:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958315136 00000100:00100000:2.0:1786960817.264784:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:2.0:1786960817.264793:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958315136:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960817.264813:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960817.264815:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786960817.264838:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fcd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c039 expref: 56 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.264857:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960817.264862:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960817.264874:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c05c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960817.265551:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1786960817.267258:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.267277:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.267287:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.267345:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97fd41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c05c expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.267362:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c05c expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.267388:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960817.267390:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960817.267393:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960817.267457:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:10546:x1873763958315136:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2664us (3368us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1786960817.267465:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:0.0:1786960817.274065:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.274152:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958315392 00000100:00100000:2.0:1786960817.274161:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958315392 00000100:00100000:2.0:1786960817.274252:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:2.0:1786960817.274262:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:10546:x1873763958315392:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960817.274321:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960817.274346:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fd48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c05c expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274364:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960817.274372:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960817.274390:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274403:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274413:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274470:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274494:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274502:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274573:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274592:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274600:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274615:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960817.274620:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274627:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274635:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:2.0:1786960817.274638:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960817.274641:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274647:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fd56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274657:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274679:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274685:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274689:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ea00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960817.274693:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274699:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274707:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x32f73bb6 (ffff976664f8cf00) 00010000:00010000:2.0:1786960817.274710:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960817.274713:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.274718:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c97fd5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x32f73bb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.274796:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958315392:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 535us (739us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786960817.274803:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:3.0:1786960817.278024:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.278132:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958315520 00000100:00100000:0.0:1786960817.278142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958315520 00000100:00100000:0.0:1786960817.278222:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:0.0:1786960817.278233:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:10546:x1873763958315520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.278252:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.278274:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fd64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c063 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278308:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278337:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278348:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278440:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fd64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278458:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.278467:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960817.278470:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786960817.278473:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1800, rc 0) 00000100:00100000:0.0:1786960817.278521:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:10546:x1873763958315520:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 291us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.278528:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:3.0:1786960817.282014:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.282279:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958315776 00000100:00100000:2.0:1786960817.282289:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958315776 00000100:00100000:2.0:1786960817.282343:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1786960817.282352:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:10546:x1873763958315776:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960817.282426:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.282451:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.282462:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960817.284042:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1786960817.284058:0:8734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 299310871236ns, next at 300310867969ns, rc = 0 00000004:00010000:0.0:1786960817.284172:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000188e9675 reply state 00000000fa35be7b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.284982:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960817.285107:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:10546:x1873763958315776:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2752us (3098us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1786960817.285117:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00010000:00010000:3.0:1786960817.288493:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288509:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288517:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288524:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ec00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960817.288528:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288535:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288551:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960817.288554:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960817.288559:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.288565:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c97fd72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.289807:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.290064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958315904 00000100:00100000:0.0:1786960817.290073:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958315904 00000100:00100000:0.0:1786960817.290136:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:0.0:1786960817.290147:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:10546:x1873763958315904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.290168:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.290229:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c06a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.290280:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.290293:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.290311:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960817.290313:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960817.290316:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960817.290363:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:10546:x1873763958315904:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 218us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.290369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1786960817.294091:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.294397:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958316032 00000100:00100000:0.0:1786960817.294406:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958316032 00000100:00100000:0.0:1786960817.294468:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1786960817.294478:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958316032:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786960817.294757:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958316032:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 279us (674us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786960817.294764:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00080000:2.0:1786960817.294910:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960817.299680:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.300052:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958316288 00000100:00100000:0.0:1786960817.300062:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958316288 00000100:00100000:0.0:1786960817.300131:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960817.300142:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:10546:x1873763958316288:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786960817.300551:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:10546:x1873763958316288:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 409us (889us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1786960817.300559:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:1.0:1786960817.303595:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.303743:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958316544 00000100:00100000:0.0:1786960817.303752:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958316544 00000100:00100000:0.0:1786960817.303844:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:0.0:1786960817.303855:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:10546:x1873763958316544:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960817.304035:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:10546:x1873763958316544:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 181us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.304043:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:1.0:1786960817.308577:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.309012:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958316672 00000100:00100000:0.0:1786960817.309022:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958316672 00000100:00100000:0.0:1786960817.309080:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1786960817.309090:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:10546:x1873763958316672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.309108:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.309138:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fd80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c071 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309241:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309256:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309284:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960817.309317:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960817.309335:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309360:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fd80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c071 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309378:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c071 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.309386:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960817.309389:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786960817.309392:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e1000, rc 0) 00000100:00100000:0.0:1786960817.309437:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:10546:x1873763958316672:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 349us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.309443:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:2.0:1786960817.313947:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.314039:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958316800 00000100:00100000:0.0:1786960817.314049:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958316800 00000100:00100000:0.0:1786960817.314105:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1786960817.314115:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2342:x1873763958316800:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.314144:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.314168:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c078 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960817.314257:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a82dbb1, blocks: 0x1 00010000:00010000:0.0:1786960817.314275:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1786960817.314281:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960817.314290:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.314309:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 10 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.314324:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0000, rc 0) 00000100:00100000:0.0:1786960817.314385:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2342:x1873763958316800:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 271us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.314392:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:1.0:1786960817.318510:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960817.318654:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317056 00000100:00100000:3.0:1786960817.318663:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317056 00000100:00100000:3.0:1786960817.318725:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:3.0:1786960817.318734:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:10546:x1873763958317056:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786960817.318838:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:10546:x1873763958317056:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 105us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960817.318846:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:3.0:1786960817.323084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.323258:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317184 00000100:00100000:0.0:1786960817.323278:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317184 00000100:00100000:0.0:1786960817.323336:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1786960817.323346:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766812d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:10546:x1873763958317184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.323364:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.323380:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c07f expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.323411:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.323437:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960817.323441:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960817.323447:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.323482:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 11 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.323495:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 11 pid: 6660 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.323509:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967765760:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960817.323587:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1786960817.329660:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.329794:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317312 00000100:00100000:1.0:1786960817.329802:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317312 00010000:00010000:1.0:1786960817.329838:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 12 pid: 6660 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.329871:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960817.329879:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2343:x1873763958317312:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960817.329892:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960817.329924:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 12 pid: 6660 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.329956:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 12 pid: 6660 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.329988:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960817.329992:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960817.330001:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.330012:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.330047:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.330061:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1873763967765888:192.168.203.23@tcp:105: 00000100:00100000:1.0:1786960817.330145:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681bafe40 going to sleep for 11 seconds 00010000:00010000:0.0:1786960817.330424:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d34166/0x1808d16e4c97fd8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c078 expref: 12 pid: 6660 timeout: 399 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.330449:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967765760:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960817.330473:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.330483:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0c00, rc 0) 00000100:00100000:0.0:1786960817.330513:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766812d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:10546:x1873763958317184:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 7169us (7439us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.330529:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1786960817.341552:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1873763967765888:192.168.203.23@tcp:105: 00010000:00010000:0.0:1786960817.341588:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960817.343214:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2343:x1873763958317312:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 13307us (13535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.343228:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1786960817.343527:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.344559:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317440 00000100:00100000:0.0:1786960817.344569:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317440 00002000:00100000:0.0:1786960817.344624:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97667ad31f80 x1873763958317440/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:403/0 lens 504/0 e 0 to 0 dl 1786960828 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960817.344635:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97667ad31f80 with x1873763958317440 ext(0->12) 00002000:00010000:0.0:1786960817.344640:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97667ad31f80 00000100:00100000:0.0:1786960817.344660:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1786960817.344823:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2344:x1873763958317440:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786960817.345432:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2344:x1873763958317440:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 611us (1904us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1786960817.345439:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:0.0:1786960817.345446:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97667ad31f80 x1873763958317440/t4294967308(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:403/0 lens 504/448 e 0 to 0 dl 1786960828 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960817.345456:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97667ad31f80 with x1873763958317440 ext(0->12) 00002000:00010000:0.0:1786960817.345460:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97667ad31f80 00000100:00100000:2.0:1786960817.349434:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.349503:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317568 00000100:00100000:1.0:1786960817.349513:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317568 00000100:00100000:1.0:1786960817.349571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1786960817.349592:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:10546:x1873763958317568:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1786960817.395082:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:0.0:1786960817.395383:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:10546:x1873763958317568:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 45788us (45952us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.395409:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000004:00080000:1.0:1786960817.395478:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1786960817.395493:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff976681baff00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1786960817.395497:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97667826c300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff976681bafc00 00000020:00080000:1.0:1786960817.395505:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97667826c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff976677229800 00000004:00080000:1.0:1786960817.395517:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1786960817.395536:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1786960817.395558:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff976643eb2840 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1786960817.395561:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9766502d5100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff976643e820c0 00000020:00080000:1.0:1786960817.395564:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9766502d5f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff976677194000 00000020:00080000:1.0:1786960817.395597:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1786960817.395763:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1786960817.395869:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967766016:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786960817.396055:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960817.396111:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967766144:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960817.396273:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960817.396310:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967766016 00000100:00100000:1.0:1786960817.396317:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967766016 00000100:00100000:1.0:1786960817.396356:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967766144 00000100:00100000:1.0:1786960817.396358:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967766144 00000100:00100000:1.0:1786960817.396374:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786960817.396381:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3288:x1873763967766016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786960817.396402:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1786960817.396424:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.396443:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.396453:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786960817.396463:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960817.396468:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.396493:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 11 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.396506:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 11 pid: 6658 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.396518:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967766272:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960817.396554:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960817.396569:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786960817.396734:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1873763967766144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786960817.396843:0:8239:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786960817.396847:0:8239:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786960817 00002000:00010000:1.0:1786960817.396849:0:8239:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786960817.396852:0:8239:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1786960817 -> 1786960817 00002000:00010000:1.0:1786960817.396854:0:8239:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786960817.397081:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1873763967766144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 320us (621us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1786960817.397089:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786960817.397116:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967766400:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786960817.397292:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786960817.397321:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1786960817.397697:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766816e2d80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1786960817.397704:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967766144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786960817.398400:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967766400 00000100:00100000:0.0:1786960817.398406:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967766400 00000100:00100000:0.0:1786960817.398456:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786960817.398464:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967766400:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786960817.398483:0:8239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1786960817.398508:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a82dbb0, atime: 0x6a82dbb0, ctime: 0x6a82dbb0, blocks: 0x1 00010000:00010000:0.0:1786960817.398515:0:8239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.398528:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=299s v=(0 0) 00010000:00010000:0.0:1786960817.398532:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960817.398538:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.398552:0:8239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.398561:0:8239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.398570:0:8239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.398594:0:8239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1786960817.399045:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960817.399435:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3286:x1873763967766400:12345-0@lo:6:osp-syn-1-0.0 Request processed in 970us (2141us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1786960817.399450:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1786960817.399471:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960817.399478:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.399487:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960817.399491:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.399499:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.399515:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.399522:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7d34166/0x1808d16e4c97fda3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.399540:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960817.399542:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960817.399544:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1786960817.400169:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97664e526d80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1786960817.400176:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967766400:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786960817.403119:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960817.408272:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.408308:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960817.408507:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317696 00000100:00100000:3.0:1786960817.408517:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317696 00010000:00010000:3.0:1786960817.408552:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 12 pid: 6658 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.408597:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1786960817.408606:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2343:x1873763958317696:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960817.408620:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960817.408626:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 12 pid: 6658 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.408638:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 12 pid: 6658 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.408682:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960817.408687:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960817.408693:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.408703:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.408722:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960817.408771:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2343:x1873763958317696:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 165us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960817.408778:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:1.0:1786960817.409731:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958317824 00000100:00100000:1.0:1786960817.409747:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958317824 00000100:00100000:1.0:1786960817.409836:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1786960817.409845:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2344:x1873763958317824:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1786960817.409944:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c97fb5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfde expref: 12 pid: 6658 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.409972:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967766272:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960817.409995:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.410004:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.410011:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.410020:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.410028:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.410047:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786960817.411091:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3288:x1873763967766016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14706us (15033us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786960817.411100:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1786960817.412266:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960817.412276:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.412290:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960817.412294:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.412305:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.412324:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.412332:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048c7cd22/0x1808d16e4c97fd9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.412349:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960817.412351:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960817.412353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786960817.412385:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766816e0000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1786960817.412392:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967766016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786960817.444539:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:2344:x1873763958317824:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 34686us (36221us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960817.444552:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000001:00080000:3.0:1786960817.447733:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1786960817.447759:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1786960817.447959:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960817.448331:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318080 00000100:00100000:3.0:1786960817.448342:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318080 00000100:00100000:2.0:1786960817.448516:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:2.0:1786960817.448527:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10546:x1873763958318080:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960817.448587:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960817.448622:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fd87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c071 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.448662:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960817.448667:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960817.448698:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.448711:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.448721:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960817.449151:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ff92d1 reply state 000000007792e4d7 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.449162:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786960817.449298:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:10546:x1873763958318080:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 773us (1408us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1786960817.449305:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:1.0:1786960817.452885:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1786960817.453456:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453470:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453478:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453485:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960817.453490:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453512:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453529:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960817.453532:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960817.453536:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.453543:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97fdaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.453693:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318208 00000100:00100000:0.0:1786960817.453703:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318208 00000100:00100000:0.0:1786960817.453785:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1786960817.453795:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958318208:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786960817.454103:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786960817.454106:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1786960817 -> 1786960816 00002000:00010000:0.0:1786960817.454109:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786960816 00002000:00010000:0.0:1786960817.454111:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1786960817 -> 1786960816 00002000:00010000:0.0:1786960817.454114:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786960817.454307:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958318208:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 512us (1430us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1786960817.454315:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1786960817.456821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960817.456983:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318464 00000100:00100000:3.0:1786960817.456991:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318464 00000100:00100000:3.0:1786960817.457047:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:3.0:1786960817.457056:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:10546:x1873763958318464:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1786960817.457118:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.457305:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.457316:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.457349:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.457362:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 15 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.457396:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967766528:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960817.457473:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acb480 going to sleep for 11 seconds 00000100:00100000:2.0:1786960817.460923:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967766528:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960817.460951:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.461086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.461859:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318592 00000100:00100000:2.0:1786960817.461867:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318592 00010000:00010000:2.0:1786960817.461909:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.461955:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1786960817.461974:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:2344:x1873763958318592:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960817.461990:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960817.461997:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462010:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462030:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fd6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c063 expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462045:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960817.462050:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462060:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462067:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.462094:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960817.462146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:2344:x1873763958318592:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 183us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960817.462153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00010000:00010000:3.0:1786960817.462526:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462534:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462562:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462570:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462576:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462583:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960817.462587:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462595:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462605:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960817.462616:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786960817.462620:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.462636:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044800/0x1808d16e4c97fdb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.462689:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10546:x1873763958318464:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 5633us (5874us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786960817.462696:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:3.0:1786960817.466559:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.466799:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318720 00000100:00100000:1.0:1786960817.466808:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318720 00000100:00100000:1.0:1786960817.466864:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1786960817.466874:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958318720:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786960817.466943:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.466972:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.466982:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960817.466986:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960817.466990:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.467026:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.467040:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 7 pid: 6659 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.467055:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967766656:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960817.467134:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960817.470105:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967766656:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960817.470148:0:6660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.472699:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960817.472944:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958318848 00000100:00100000:1.0:1786960817.472953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958318848 00010000:00010000:1.0:1786960817.473001:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 8 pid: 6659 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.473054:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1786960817.473064:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958318848:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960817.473079:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960817.473102:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 8 pid: 6659 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.473114:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 8 pid: 6659 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.473434:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000bc71ba/0x1808d16e4c97fd95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c07f expref: 8 pid: 6659 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.473450:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960817.473455:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960817.473460:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.473470:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960817.473504:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960817.473613:0:6660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473622:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473647:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473656:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473664:0:6660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473671:0:6660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960817.473675:0:6660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473698:0:6660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473711:0:6660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.473719:0:6660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008624c4a0/0x1808d16e4c97fdb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960817.473784:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958318848:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 720us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960817.473792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:0.0:1786960817.476854:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958318720:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 9970us (10292us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.476868:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960817.480703:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.480796:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958319104 00000100:00100000:0.0:1786960817.480805:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958319104 00000100:00100000:0.0:1786960817.480888:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:0.0:1786960817.480907:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10546:x1873763958319104:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786960817.480993:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481010:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481022:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481490:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481511:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481519:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481550:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.481564:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 15 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.481589:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967766784:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960817.481660:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960817.484697:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967766784:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960817.484723:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.485902:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960817.486026:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958319232 00000100:00100000:3.0:1786960817.486034:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958319232 00010000:00010000:3.0:1786960817.486067:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960817.486105:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1786960817.486114:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:2343:x1873763958319232:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960817.486136:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960817.486144:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486157:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486178:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fd79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c06a expref: 16 pid: 5811 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486222:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960817.486239:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486249:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486257:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960817.486276:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960817.486323:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:2343:x1873763958319232:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 210us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960817.486330:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00010000:00010000:0.0:1786960817.486445:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.486453:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960817.486633:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1786960817.486754:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1786960817.486791:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1786960817.486859:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1873763967766912:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786960817.486911:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960817.486940:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abd180 going to sleep for 11 seconds 00000100:00100000:3.0:1786960817.487081:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967766912 00000100:00100000:3.0:1786960817.487087:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967766912 00000100:00100000:3.0:1786960817.487177:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960817.487375:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1873763967766912:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786960817.487454:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1873763967766912:12345-0@lo:1000:mdt00_000.0 Request processed in 268us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960817.487460:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960817.487860:0:5810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1786960817.487865:0:5810:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1786960817.487903:0:5810:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766816e2d80, transno 4294967309 00000004:00080000:0.0:1786960817.487914:0:5810:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766816e0000, transno 4294967310 00000100:00100000:0.0:1786960817.487921:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1873763967766912:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1786960817.488362:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1786960817.488424:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1873763967767040:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786960817.488468:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960817.488525:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967767040 00000100:00100000:0.0:1786960817.488532:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967767040 00000100:00100000:0.0:1786960817.488569:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960817.488595:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1873763967767040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786960817.490701:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1873763967767040:12345-0@lo:1000:mdt00_000.0 Request processed in 2118us (2227us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1786960817.490713:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960817.490747:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976677abdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960817.490776:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1873763967767040:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1786960817.490813:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490823:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490830:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490837:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.490841:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490849:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490871:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960817.490874:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960817.490879:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490886:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fdc6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490925:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490932:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490937:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490942:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fe00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.490945:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490950:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490958:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960817.490970:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960817.490977:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.490988:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.491003:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.491034:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.491048:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967767168:192.168.203.23@tcp:105: 00000100:00100000:0.0:1786960817.491112:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960817.495815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.495933:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967767168:192.168.203.23@tcp:105: 00010000:00010000:0.0:1786960817.495970:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.495981:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fd09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496013:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496026:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496038:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496050:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496057:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496078:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496083:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.496086:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496095:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496110:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960817.496114:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960817.496118:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496140:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fdcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496154:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496162:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496168:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496175:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.496179:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496251:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496263:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960817.496267:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786960817.496271:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.496278:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fdbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.496507:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10546:x1873763958319104:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 15608us (15810us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1786960817.496516:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000020:00080000:0.0:1786960817.496521:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786960817.496761:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960817.496766:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960817.497290:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786960817.497302:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786960817.497869:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958319360 00000100:00100000:3.0:1786960817.497879:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958319360 00000100:00100000:3.0:1786960817.497952:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:3.0:1786960817.497972:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10544:x1873763958319360:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:3.0:1786960817.498078:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10544:x1873763958319360:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 117us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960817.498085:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1786960817.505558:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.505668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.506173:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958319872 00000100:00100000:0.0:1786960817.506183:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958319872 00000100:00100000:0.0:1786960817.506284:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:0.0:1786960817.506294:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10544:x1873763958319872:12345-192.168.203.23@tcp:58:lfs.0 00000040:00080000:0.0:1786960817.506665:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1786960817.506805:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10544:x1873763958319872:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 512us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.506813:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:3.0:1786960817.507311:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958319616 00000100:00100000:3.0:1786960817.507324:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958319616 00000100:00100000:3.0:1786960817.507362:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1786960817.507369:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:10546:x1873763958319616:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786960817.520820:0:5813:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786960817.520977:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1786960817.521052:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521069:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521080:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521089:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521096:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521103:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.521130:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786960817.521353:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10546:x1873763958319616:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 13979us (15798us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1786960817.521375:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000020:00080000:2.0:1786960817.521382:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786960817.522418:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960817.522427:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.522445:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960817.522457:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.522466:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.522480:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:0.0:1786960817.522483:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786960817.522487:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.522492:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c97fdd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.522509:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960817.522511:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960817.522512:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960817.553392:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.553459:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320000 00000100:00100000:0.0:1786960817.553468:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320000 00000100:00100000:0.0:1786960817.553526:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:0.0:1786960817.553538:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:10548:x1873763958320000:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960817.553564:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960817.553585:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fddb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c086 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553647:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553661:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553673:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553701:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553709:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.553717:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.554008:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.554020:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 21 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.554029:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.554059:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 21 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.554086:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 21 pid: 8734 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960817.554100:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967767296:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960817.554177:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960817.556373:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967767296:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960817.556401:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.557566:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960817.557857:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320256 00000100:00100000:0.0:1786960817.557866:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320256 00000100:00100000:0.0:1786960817.557920:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1786960817.557929:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:5580:x1873763958320256:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786960817.558162:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:5580:x1873763958320256:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 233us (609us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1786960817.558169:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1786960817.561639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960817.561735:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320384 00000100:00100000:2.0:1786960817.561745:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320384 00010000:00010000:2.0:1786960817.561786:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 23 pid: 8734 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960817.561828:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:2.0:1786960817.561838:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:2343:x1873763958320384:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960817.561853:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960817.561859:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 23 pid: 8734 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561872:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 23 pid: 8734 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561894:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fcfb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c047 expref: 23 pid: 8734 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561913:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960817.561919:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561928:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561951:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960817.561989:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960817.562037:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2343:x1873763958320384:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 201us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960817.562045:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00010000:00010000:0.0:1786960817.565103:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565119:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960817.565166:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786960817.565171:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960817.565220:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565235:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565247:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565254:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565261:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565289:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.565293:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565300:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565314:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960817.565317:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960817.565321:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565327:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fde2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565341:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565348:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565353:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565357:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960817.565359:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565365:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565381:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9766559de100) 00010000:00010000:0.0:1786960817.565384:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960817.565386:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565392:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fde9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565430:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fddb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c086 expref: 22 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565444:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c086 expref: 21 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960817.565451:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960817.565453:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960817.565455:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0600, rc 0) 00000100:00100000:0.0:1786960817.565521:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10548:x1873763958320000:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 11984us (12137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960817.565530:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:3.0:1786960818.339449:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.339495:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.339528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.339547:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.339574:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.339595:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320896 00000100:00100000:3.0:1786960818.339602:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320896 00000100:00100000:3.0:1786960818.339643:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320768 00000100:00100000:3.0:1786960818.339645:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320768 00000100:00100000:3.0:1786960818.339657:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1786960818.339663:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958320896:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960818.339736:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958320896:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960818.339744:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1786960818.339760:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1786960818.339767:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958320768:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960818.339792:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958320768:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960818.339797:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1786960818.339815:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320512 00000100:00100000:3.0:1786960818.339818:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320512 00000100:00100000:3.0:1786960818.339842:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:3.0:1786960818.339849:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958320512:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960818.339886:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958320512:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 38us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960818.339892:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 290 00000100:00100000:3.0:1786960818.339919:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958320640 00000100:00100000:3.0:1786960818.339922:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958320640 00000100:00100000:2.0:1786960818.340183:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958321024 00000100:00100000:2.0:1786960818.340211:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958321024 00000100:00100000:2.0:1786960818.340242:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:2.0:1786960818.340249:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:2342:x1873763958320640:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960818.340281:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:2342:x1873763958320640:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 34us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960818.340287:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:2.0:1786960818.340299:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:2.0:1786960818.340306:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958321024:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960818.340329:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958321024:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960818.340334:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00080000:3.0:1786960818.341061:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786960818.341066:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1786960818.422223:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960818.463442:0:12075:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960818.463451:0:12075:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786960818.463500:0:12075:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1786960818.463508:0:12075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1786960818.552371:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960818.552380:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960818.552429:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1786960818.552436:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786960818.552549:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967767424:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786960818.552644:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766469af000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960818.555914:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960818.556589:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958321152 00000100:00100000:1.0:1786960818.556598:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958321152 00000100:00100000:1.0:1786960818.556658:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:1.0:1786960818.556669:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10560:x1873763958321152:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786960818.556709:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786960818.556810:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10560:x1873763958321152:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 142us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960818.556818:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:2.0:1786960818.563325:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967767424:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786960818.568449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960818.568803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958321408 00000100:00100000:2.0:1786960818.568814:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958321408 00000100:00100000:2.0:1786960818.568876:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:2.0:1786960818.568886:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:10560:x1873763958321408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960818.568907:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960818.568927:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fdf7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c08d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.569145:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fdfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.569159:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.569171:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960818.569182:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786960818.569333:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c97fdf7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c08d expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.569348:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fdfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c08d expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.569356:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960818.569358:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960818.569362:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e800, rc 0) 00000100:00100000:2.0:1786960818.569422:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:10560:x1873763958321408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 538us (982us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1786960818.569436:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:1.0:1786960818.575032:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960818.575109:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958321536 00000100:00100000:3.0:1786960818.575118:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958321536 00000100:00100000:3.0:1786960818.575208:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960818.575218:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:2342:x1873763958321536:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960818.575629:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960818.575653:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c97fdfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c08d expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960818.575672:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:2.0:1786960818.575676:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960818.575737:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2342:x1873763958321536:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 521us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960818.575745:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960818.576912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960818.577935:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958321792 00000100:00100000:1.0:1786960818.578434:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958321792 00000100:00100000:1.0:1786960818.582050:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:1.0:1786960818.582065:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:10560:x1873763958321792:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786960818.582143:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582160:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582171:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582480:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582488:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582494:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582499:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960818.582504:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582510:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582522:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:1.0:1786960818.582525:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786960818.582529:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960818.582534:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960818.582684:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:10560:x1873763958321792:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 620us (5778us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1786960818.582692:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000040:00080000:3.0:1786960818.584099:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786960818.584106:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786960818.586309:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786960818.586322:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786960818.587361:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960818.587458:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322048 00000100:00100000:0.0:1786960818.587467:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322048 00000100:00100000:0.0:1786960818.587522:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1786960818.587532:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:10560:x1873763958322048:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786960818.587759:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10560:x1873763958322048:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 227us (403us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1786960818.587775:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00010000:00010000:0.0:1786960819.444475:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786960820.097110:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1786960820.097136:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:0.0:1786960820.431679:0:12127:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960820.431690:0:12127:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960820.431737:0:12127:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786960820.431743:0:12127:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786960820.468355:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960820.669007:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960820.669103:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322304 00000100:00100000:0.0:1786960820.669112:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322304 00000100:00100000:0.0:1786960820.669227:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1786960820.669239:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:10581:x1873763958322304:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960820.669263:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960820.669296:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c094 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.669415:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fe1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.669429:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fe1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.669439:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fe1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960820.669451:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1786960820.669574:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c094 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.669610:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fe1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c094 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.669619:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960820.669622:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786960820.669625:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0c00, rc 0) 00000100:00100000:0.0:1786960820.669678:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10581:x1873763958322304:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 442us (679us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1786960820.669685:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00080000:3.0:1786960820.670441:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960820.676349:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960820.676549:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322432 00000100:00100000:0.0:1786960820.676561:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322432 00000100:00100000:0.0:1786960820.676622:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:0.0:1786960820.676633:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10581:x1873763958322432:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1786960820.676697:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676715:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676727:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676755:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676762:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676785:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676792:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960820.676796:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676803:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676816:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960820.676820:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960820.676824:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960820.676831:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960820.676976:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:10581:x1873763958322432:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 345us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960820.676985:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1786960820.782932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960820.783058:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322560 00000100:00100000:3.0:1786960820.783067:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322560 00000100:00080000:2.0:1786960820.783287:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960820.783368:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1786960820.783380:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958322560:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1786960820.783493:0:8239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960820.783514:0:8239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c97fe2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c09b expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960820.783553:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a82dbb0, atime: 0x6a82dbb0, ctime: 0x6a82dbb0, blocks: 0xb 00010000:00010000:3.0:1786960820.783571:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1786960820.783575:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960820.783584:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c97fe2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c09b expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960820.783601:0:8239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c97fe2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c09b expref: 7 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960820.783614:0:8239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044800, rc 0) 00000100:00100000:3.0:1786960820.783715:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2341:x1873763958322560:12345-192.168.203.23@tcp:101:cat.0 Request processed in 338us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960820.783723:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1786960820.793867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960820.793993:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322688 00000100:00100000:0.0:1786960820.794003:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322688 00002000:00100000:0.0:1786960820.794050:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9766772faa00 x1873763958322688/t0(0) o3->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:406/0 lens 488/0 e 0 to 0 dl 1786960831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960820.794060:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766772faa00 with x1873763958322688 ext(0->4095) 00002000:00010000:0.0:1786960820.794065:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766772faa00 00000100:00100000:0.0:1786960820.794096:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1786960820.794105:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958322688:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:0.0:1786960820.794765:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2342:x1873763958322688:12345-192.168.203.23@tcp:3:cat.0 Request processed in 660us (906us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786960820.794772:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:0.0:1786960820.794777:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9766772faa00 x1873763958322688/t0(0) o3->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:406/0 lens 488/4536 e 0 to 0 dl 1786960831 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960820.794890:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766772faa00 with x1873763958322688 ext(0->4095) 00002000:00010000:0.0:1786960820.794894:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766772faa00 00000100:00100000:1.0:1786960821.044953:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967767552:0@lo:400:kworker.0 00000100:00100000:2.0:1786960821.044985:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967767680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960821.045024:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960821.045039:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960821.045710:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967767552 00000100:00100000:0.0:1786960821.045719:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967767552 00000100:00100000:0.0:1786960821.045766:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786960821.045775:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967767552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960821.045918:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967767552:12345-0@lo:400:kworker.0 Request processed in 143us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.045926:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1786960821.045979:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967767808:0@lo:400:kworker.0 00000100:00100000:0.0:1786960821.046004:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960821.046085:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960821.046091:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967767936:0@lo:400:kworker.0 00000100:00100000:0.0:1786960821.046548:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960821.046577:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967767680 00000100:00100000:0.0:1786960821.046581:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967767680 00000100:00100000:0.0:1786960821.046614:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786960821.046620:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967767680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960821.046645:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960821.046673:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967767680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.046692:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1786960821.046707:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960821.046717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967767808 00000100:00100000:0.0:1786960821.046720:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967767808 00000100:00100000:0.0:1786960821.046737:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967767936 00000100:00100000:0.0:1786960821.046739:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967767936 00000100:00100000:0.0:1786960821.046757:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786960821.046762:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967767808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960821.046898:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967767680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960821.046914:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960821.046919:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967768064:0@lo:400:kworker.0 00000100:00100000:2.0:1786960821.046952:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960821.046973:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768064 00000100:00100000:2.0:1786960821.046976:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768064 00000100:00100000:2.0:1786960821.046994:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1786960821.046999:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967767936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960821.047089:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967767936:12345-0@lo:400:kworker.0 Request processed in 89us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960821.047095:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786960821.047169:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967767808:12345-0@lo:400:kworker.0 Request processed in 406us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.047236:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786960821.047247:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1786960821.047252:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967768064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960821.047282:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967768064:12345-0@lo:400:kworker.0 Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.047287:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1786960821.047298:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960821.047313:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967767936:0@lo:400:kworker.0 00000100:00100000:2.0:1786960821.047499:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967768064:0@lo:400:kworker.0 00000100:00100000:0.0:1786960821.047583:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967767808:0@lo:400:kworker.0 00000100:00100000:1.0:1786960821.051691:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766743abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967767552:0@lo:400:kworker.0 00000100:00100000:1.0:1786960821.053097:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960821.053114:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967768192:0@lo:400:kworker.0 00000100:00100000:1.0:1786960821.053178:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960821.053290:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768192 00000100:00100000:0.0:1786960821.053297:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768192 00000100:00100000:0.0:1786960821.053356:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786960821.053366:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967768192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786960821.053397:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960821.053424:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967768192:12345-0@lo:400:kworker.0 Request processed in 60us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.053431:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786960821.053438:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1786960821.053443:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1786960821.053464:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97664e526d80, transno 4294967304 00000100:00100000:1.0:1786960821.053473:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967768192:0@lo:400:kworker.0 00010000:00010000:3.0:1786960821.492379:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960821.579354:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967768320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960821.579424:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960821.579497:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768320 00000100:00100000:0.0:1786960821.579505:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768320 00000100:00100000:0.0:1786960821.579562:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786960821.579572:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967768320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960821.579613:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960821.579659:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967768320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960821.579666:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786960821.579708:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967768320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786960822.516387:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786960822.618886:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1786960822.618898:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1786960822.643418:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1786960822.643440:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff976677abd180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1786960822.643445:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97666b6bcd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff976677abdb40 00000020:00080000:1.0:1786960822.643448:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97666b6bce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97667726c800 00000020:00080000:1.0:1786960822.643471:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1786960822.643496:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1786960822.643694:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1786960823.449138:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960823.449232:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960823.449269:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960823.449295:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960823.449323:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960823.449427:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323200 00000100:00100000:2.0:1786960823.449439:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323200 00000100:00100000:2.0:1786960823.449525:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323072 00000100:00100000:2.0:1786960823.449529:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323072 00000100:00100000:2.0:1786960823.449556:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:2.0:1786960823.449568:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958323200:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960823.449660:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958323200:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 95us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960823.449669:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:2.0:1786960823.449688:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:2.0:1786960823.449695:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958323072:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960823.449721:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2342:x1873763958323072:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960823.449727:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:1.0:1786960823.450484:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322816 00000100:00100000:1.0:1786960823.450492:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322816 00000100:00100000:1.0:1786960823.450536:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00100000:1.0:1786960823.450564:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958322816:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960823.450606:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958322816:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 44us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960823.450613:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 292 00000100:00080000:1.0:1786960823.450650:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960823.450655:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960823.450931:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958322944 00000100:00100000:0.0:1786960823.450936:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958322944 00000100:00100000:0.0:1786960823.450984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323328 00000100:00100000:0.0:1786960823.450988:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323328 00000100:00100000:0.0:1786960823.451012:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:0.0:1786960823.451019:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2342:x1873763958322944:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960823.451058:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2342:x1873763958322944:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 39us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960823.451065:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:0.0:1786960823.451077:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:0.0:1786960823.451083:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958323328:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960823.451104:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958323328:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960823.451110:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00080000:1.0:1786960823.451385:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786960823.540478:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786960823.735364:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960823.735376:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960823.735443:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786960823.735452:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786960824.564458:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960825.591341:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960826.158583:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960826.161816:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323456 00000100:00100000:0.0:1786960826.161830:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323456 00000100:00100000:0.0:1786960826.161932:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:0.0:1786960826.161945:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10224:x1873763958323456:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786960826.162062:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10224:x1873763958323456:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 121us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960826.162070:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00080000:1.0:1786960826.162142:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960826.164409:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960826.164430:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960826.164489:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960826.164549:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967768832:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164575:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960826.164584:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967768576:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164600:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960826.164605:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967768960:0@lo:400:kworker.0 00000100:00100000:3.0:1786960826.164616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960826.164622:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960826.164637:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769088:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164649:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768832 00000100:00100000:1.0:1786960826.164654:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768832 00000100:00100000:3.0:1786960826.164672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960826.164697:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768960 00000100:00100000:3.0:1786960826.164700:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960826.164700:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768960 00000100:00100000:3.0:1786960826.164705:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967768704:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164721:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1786960826.164724:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960826.164728:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967768832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960826.164745:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769088 00000100:00100000:3.0:1786960826.164748:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769088 00000100:00100000:1.0:1786960826.164770:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967768832:12345-0@lo:400:kworker.0 Request processed in 43us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960826.164776:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1786960826.164787:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768704 00000100:00100000:3.0:1786960826.164788:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786960826.164794:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164794:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768704 00000100:00100000:1.0:1786960826.164808:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786960826.164812:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967768960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960826.164826:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769088:12345-0@lo:400:kworker.0 Request processed in 33us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960826.164831:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786960826.164834:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967768960:12345-0@lo:400:kworker.0 Request processed in 22us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960826.164839:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1786960826.164847:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1786960826.164852:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960826.164868:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769088:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164873:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967768704:12345-0@lo:400:kworker.0 Request processed in 22us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960826.164877:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1786960826.164885:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967768704:0@lo:400:kworker.0 00000100:00080000:1.0:1786960826.164894:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960826.164898:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960826.164923:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967768960:0@lo:400:kworker.0 00000100:00100000:1.0:1786960826.164932:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967768832:0@lo:400:kworker.0 00000100:00100000:2.0:1786960826.164996:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768448 00000100:00100000:2.0:1786960826.165000:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768448 00000100:00100000:2.0:1786960826.165044:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1786960826.165052:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967768448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960826.165078:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960826.165101:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967768576 00000100:00100000:0.0:1786960826.165105:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967768576 00000100:00100000:2.0:1786960826.165114:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967768448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960826.165119:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786960826.165127:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1786960826.165133:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967768576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960826.165174:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967768576:12345-0@lo:400:kworker.0 Request processed in 42us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960826.165180:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:0.0:1786960826.165226:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960826.165240:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1786960826.165245:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1786960826.165264:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967768448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960826.165359:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967768576:0@lo:400:kworker.0 00000100:00100000:2.0:1786960826.168579:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960826.168700:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323712 00000100:00100000:1.0:1786960826.168713:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323712 00000100:00100000:1.0:1786960826.168787:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:1.0:1786960826.168799:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:10224:x1873763958323712:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786960826.169517:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:10224:x1873763958323712:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 715us (947us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1786960826.169528:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00010000:00010000:0.0:1786960826.612542:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960826.651399:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960826.651474:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323840 00000100:00100000:1.0:1786960826.651483:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323840 00000100:00100000:1.0:1786960826.651619:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:1.0:1786960826.651630:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:11033:x1873763958323840:12345-192.168.203.23@tcp:101:lsof.0 00010000:00010000:1.0:1786960826.651649:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960826.651669:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fe36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0a2 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.651969:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.651983:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.651995:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960826.652290:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786960826.652295:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960826.652463:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.652490:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97fe36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 7 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.652507:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 6 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960826.652516:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:1.0:1786960826.652519:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960826.652529:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92e00, rc 0) 00000100:00100000:1.0:1786960826.652593:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:11033:x1873763958323840:12345-192.168.203.23@tcp:101:lsof.0 Request processed in 965us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960826.652601:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00080000:0.0:1786960826.655520:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960826.676530:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960826.676744:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960826.676814:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960826.678431:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769216 00000100:00100000:0.0:1786960826.678440:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769216 00000100:00100000:0.0:1786960826.678543:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786960826.678554:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960826.678590:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960826.678734:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960826.678742:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786960826.678826:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960827.639235:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786960827.801345:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1786960827.801376:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1786960827.801788:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1786960827.801803:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1786960828.569369:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960828.569423:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960828.569457:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960828.569491:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960828.569524:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960828.569558:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324480 00000100:00100000:3.0:1786960828.569570:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324480 00000100:00100000:3.0:1786960828.569639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324096 00000100:00100000:3.0:1786960828.569643:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324096 00000100:00100000:3.0:1786960828.569674:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:3.0:1786960828.569687:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2344:x1873763958324480:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960828.569786:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2344:x1873763958324480:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 101us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960828.569794:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:3.0:1786960828.569813:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:3.0:1786960828.569820:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2344:x1873763958324096:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960828.569861:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2344:x1873763958324096:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960828.569897:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:1.0:1786960828.570499:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958323968 00000100:00100000:1.0:1786960828.570506:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958323968 00000100:00100000:1.0:1786960828.570551:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 294 00000100:00100000:1.0:1786960828.570558:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958323968:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960828.570608:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958323968:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 50us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960828.570615:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 294 00000100:00100000:1.0:1786960828.570653:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324224 00000100:00100000:1.0:1786960828.570657:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324224 00000100:00100000:1.0:1786960828.570688:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324352 00000100:00100000:1.0:1786960828.570691:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324352 00000100:00100000:1.0:1786960828.570712:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:1.0:1786960828.570719:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958324224:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960828.570747:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958324224:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960828.570754:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:1.0:1786960828.570765:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:1.0:1786960828.570771:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958324352:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960828.570795:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958324352:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960828.570813:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00080000:1.0:1786960828.570836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960828.570840:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960828.570843:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786960828.661793:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960829.686945:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960830.711117:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786960831.075716:0:12331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:00:29 (1786960829) 00000100:00100000:2.0:1786960831.285214:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967769600:0@lo:400:kworker.0 00000100:00100000:2.0:1786960831.285310:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960831.285378:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960831.285386:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769728:0@lo:400:kworker.0 00000100:00100000:2.0:1786960831.285417:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960831.285604:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967769344:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.285659:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960831.285682:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967769856:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.285704:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960831.285724:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786960831.285729:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967769472:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.285752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960831.285771:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967769984:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.285792:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960831.285828:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769600 00000100:00100000:3.0:1786960831.285836:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769600 00000100:00100000:3.0:1786960831.285909:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769856 00000100:00100000:3.0:1786960831.285913:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769856 00000100:00100000:3.0:1786960831.285929:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769472 00000100:00100000:3.0:1786960831.285932:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769472 00000100:00100000:3.0:1786960831.285949:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786960831.285960:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967769600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286020:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967769600:12345-0@lo:400:kworker.0 Request processed in 62us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960831.286029:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786960831.286051:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1786960831.286058:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967769856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286090:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967769856:12345-0@lo:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960831.286114:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1786960831.286126:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786960831.286132:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967769472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286163:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967769472:12345-0@lo:400:kworker.0 Request processed in 31us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960831.286169:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786960831.286219:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769728 00000100:00100000:3.0:1786960831.286224:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769728 00000100:00100000:3.0:1786960831.286253:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769984 00000100:00100000:3.0:1786960831.286256:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769984 00000100:00100000:3.0:1786960831.286276:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786960831.286283:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286316:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967769728:12345-0@lo:400:kworker.0 Request processed in 33us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960831.286323:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786960831.286334:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786960831.286340:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967769984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286367:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967769984:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960831.286373:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786960831.286423:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967769472:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286435:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967769984:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.286457:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967769856:0@lo:400:kworker.0 00000100:00100000:2.0:1786960831.286928:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967769728:0@lo:400:kworker.0 00000100:00100000:2.0:1786960831.286942:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967769600:0@lo:400:kworker.0 00000100:00100000:1.0:1786960831.288119:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967769344 00000100:00100000:1.0:1786960831.288134:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967769344 00000100:00100000:1.0:1786960831.288315:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1786960831.288326:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967769344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960831.288425:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967769344:12345-0@lo:400:kworker.0 Request processed in 100us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960831.288438:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1786960831.288495:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960831.288501:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960831.288505:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960831.288545:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967769344:0@lo:400:kworker.0 00000100:00100000:3.0:1786960831.289032:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960831.289059:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967770112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960831.289108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960831.289246:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967770112 00000100:00100000:0.0:1786960831.289252:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967770112 00000100:00100000:0.0:1786960831.289288:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786960831.289297:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ab7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967770112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960831.289335:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960831.289385:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ab7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967770112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960831.289392:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786960831.289832:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967770112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786960831.734429:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960831.797122:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960831.797160:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967770240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960831.797292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960831.797833:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967770240 00000100:00100000:0.0:1786960831.797845:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967770240 00000100:00100000:0.0:1786960831.797929:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786960831.797940:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967770240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960831.797997:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960831.798066:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967770240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960831.798075:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786960831.798396:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967770240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786960832.757017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960832.886262:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960832.886837:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324736 00000100:00100000:0.0:1786960832.886850:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324736 00000100:00100000:0.0:1786960832.886987:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:0.0:1786960832.887002:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:11298:x1873763958324736:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960832.887030:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960832.887075:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0a9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887224:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887240:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887253:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887271:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887277:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887284:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.887997:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888009:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888016:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960832.888027:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1786960832.888895:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888920:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888926:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888933:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960832.888938:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888946:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888961:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766559de900) 00010000:00010000:0.0:1786960832.888964:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960832.888970:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888975:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c97fe4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888990:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.888995:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.889000:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.889005:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960832.889013:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.889019:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.889028:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9766559de100) 00010000:00010000:0.0:1786960832.889031:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960832.889034:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.889040:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c97fe52 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786960832.889410:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786960832.890135:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c97fe44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a9 expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.890170:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a9 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960832.890179:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960832.890182:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960832.890211:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168c00, rc 0) 00000100:00100000:0.0:1786960832.890308:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:11298:x1873763958324736:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3309us (4060us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1786960832.890318:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:2.0:1786960832.900328:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960832.900454:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960832.900555:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324992 00000100:00100000:1.0:1786960832.900565:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324992 00000100:00100000:1.0:1786960832.900637:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1786960832.900647:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:2341:x1873763958324992:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960832.900662:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960832.900686:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a9 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960832.900733:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:1.0:1786960832.900739:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960832.900803:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2341:x1873763958324992:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 157us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960832.900811:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1786960832.901157:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958324864 00000100:00100000:3.0:1786960832.901162:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958324864 00000100:00100000:3.0:1786960832.901313:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:3.0:1786960832.901322:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11298:x1873763958324864:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786960832.901560:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11298:x1873763958324864:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 238us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960832.901568:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000040:00080000:0.0:1786960832.948428:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960832.948438:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960832.949180:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1786960832.949231:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786960833.696383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960833.696419:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960833.696439:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960833.696462:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960833.696869:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325376 00000100:00100000:2.0:1786960833.696884:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325376 00000100:00100000:2.0:1786960833.696934:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325248 00000100:00100000:2.0:1786960833.696936:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325248 00000100:00100000:2.0:1786960833.696955:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1786960833.696965:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958325376:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960833.697174:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325120 00000100:00100000:3.0:1786960833.697179:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325120 00000100:00100000:3.0:1786960833.697421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 296 00000100:00100000:3.0:1786960833.697430:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958325120:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960833.697522:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2343:x1873763958325376:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 558us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960833.697530:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1786960833.697548:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1786960833.697555:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958325248:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:0.0:1786960833.699233:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960833.699241:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960833.699256:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325504 00000100:00100000:0.0:1786960833.699266:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325504 00000100:00100000:0.0:1786960833.699323:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:0.0:1786960833.699332:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2343:x1873763958325504:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960833.701603:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958325248:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 4037us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960833.701618:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:3.0:1786960833.704448:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958325120:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 7008us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960833.704461:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 296 00000100:00100000:0.0:1786960833.705343:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2343:x1873763958325504:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 6007us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960833.705354:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00080000:0.0:1786960833.705390:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786960833.780424:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960833.972977:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960833.972985:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786960833.978809:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1786960833.978823:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786960834.717905:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960834.718402:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325632 00000100:00100000:0.0:1786960834.718415:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325632 00000100:00100000:0.0:1786960834.718511:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:0.0:1786960834.718525:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11340:x1873763958325632:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960834.718551:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960834.718592:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0b0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718685:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718702:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718719:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718735:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718758:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.718765:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786960834.718930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786960834.720718:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720735:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720742:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720749:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960834.720754:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720762:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720781:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960834.720784:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960834.720790:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.720796:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723344:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723371:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723379:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723387:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960834.723392:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723401:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723422:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9766559de500) 00010000:00010000:0.0:1786960834.723427:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960834.723432:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723448:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723538:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0b0 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723686:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960834.723690:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960834.723695:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0b0 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.723712:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169000, rc 0) 00000100:00100000:1.0:1786960834.725437:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11340:x1873763958325632:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 6901us (7533us total) trans 0 rc 301/301 00000100:00100000:1.0:1786960834.725453:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:0.0:1786960834.737108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960834.737979:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958325888 00000100:00100000:3.0:1786960834.737995:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958325888 00000100:00100000:3.0:1786960834.738067:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:3.0:1786960834.738083:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11340:x1873763958325888:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1786960834.738158:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960834.738208:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97f7e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bee9 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.738248:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:3.0:1786960834.738254:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960834.740164:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.740209:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 5 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.740219:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.740268:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 5 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.740290:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 5 pid: 8734 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960834.740309:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967770368:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960834.742820:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960834.751577:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967770368:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960834.751619:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960834.759556:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960834.759970:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326016 00000100:00100000:0.0:1786960834.759983:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326016 00010000:00010000:0.0:1786960834.760039:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 6 pid: 8734 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960834.760098:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:0.0:1786960834.760109:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2344:x1873763958326016:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960834.760126:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960834.760134:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 6 pid: 8734 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760149:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 6 pid: 8734 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760177:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0a2 expref: 6 pid: 8734 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760220:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:0.0:1786960834.760227:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760237:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760245:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760278:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960834.760353:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958326016:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 245us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960834.760362:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00010000:00010000:0.0:1786960834.760391:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760400:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760529:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760541:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.760549:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960834.765878:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786960834.765908:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.765921:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.765931:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.765939:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960834.765944:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.765967:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.765987:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9766559dea00) 00010000:00010000:1.0:1786960834.765991:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960834.765997:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.766004:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97fe7c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960834.766028:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000143819a7 reply state 00000000a7d50d09 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960834.766038:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960834.766292:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:11340:x1873763958325888:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 28210us (34438us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1786960834.766302:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 140 00010000:00010000:3.0:1786960834.769967:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.769990:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.769998:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.770027:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960834.770032:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.770040:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.770061:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9766559de500) 00010000:00010000:3.0:1786960834.770065:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960834.770070:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.770161:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fe83 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960834.804400:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960834.837658:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960834.837778:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326144 00000100:00100000:1.0:1786960834.837790:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326144 00000100:00100000:1.0:1786960834.837868:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:1.0:1786960834.837880:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:11348:x1873763958326144:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:1.0:1786960834.837911:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960834.837943:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0b7 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838028:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838066:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838080:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960834.838157:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786960834.838161:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960834.838250:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838281:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c97fe8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0b7 expref: 16 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838304:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0b7 expref: 15 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.838314:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:1.0:1786960834.838317:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960834.838322:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92000, rc 0) 00000100:00100000:1.0:1786960834.838398:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:11348:x1873763958326144:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 520us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960834.838406:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:1.0:1786960834.931910:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960834.932415:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326272 00000100:00100000:0.0:1786960834.932429:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326272 00000100:00100000:0.0:1786960834.932499:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:0.0:1786960834.932509:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+15:11354:x1873763958326272:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960834.932534:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960834.932558:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0be expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932759:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932777:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932809:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932827:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932834:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932841:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932981:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932988:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.932995:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960834.933028:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1786960834.933031:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960834.933054:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933068:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933075:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933148:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933155:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960834.933160:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933168:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933182:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:0.0:1786960834.933300:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960834.933307:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933314:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97fe9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933341:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933347:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933353:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933358:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960834.933361:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933376:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933384:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9766559de700) 00010000:00010000:0.0:1786960834.933386:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960834.933388:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933393:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97fea6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933435:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c97fe98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0be expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933451:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0be expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.933458:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960834.933460:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786960834.933462:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169200, rc 0) 00000100:00100000:0.0:1786960834.933538:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11354:x1873763958326272:12345-192.168.203.23@tcp:101:bash.0 Request processed in 1030us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960834.933546:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 142 00000100:00100000:2.0:1786960834.948543:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960834.948655:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326528 00000100:00100000:3.0:1786960834.948668:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326528 00000100:00100000:3.0:1786960834.948743:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:3.0:1786960834.948755:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11354:x1873763958326528:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960834.948784:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960834.948822:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97feb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.949019:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.949038:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.949074:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.954654:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.954677:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.954689:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786960834.955354:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1786960834.955524:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955535:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955544:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955580:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955587:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955593:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955600:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960834.955612:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955620:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955632:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:3.0:1786960834.955635:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960834.955639:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955646:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c97febb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960834.955659:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000376fade8 reply state 0000000007165364 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960834.955667:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786960834.955707:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c97feb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955721:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.955728:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:3.0:1786960834.955730:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960834.955732:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:3.0:1786960834.956011:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11354:x1873763958326528:12345-192.168.203.23@tcp:101:bash.0 Request processed in 7257us (7481us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1786960834.956019:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00010000:00010000:3.0:1786960834.963675:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963691:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963698:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963704:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960834.963708:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963716:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963731:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976643e01e00) 00010000:00010000:3.0:1786960834.963734:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960834.963738:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.963744:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c97fec2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960834.966768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960834.972977:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326656 00000100:00100000:0.0:1786960834.972992:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326656 00000100:00100000:0.0:1786960834.973066:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1786960834.973077:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958326656:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960834.973112:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960834.973133:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0cc expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960834.973161:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786960834.973181:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1786960834.973202:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960834.973212:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.973242:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960834.973257:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168c00, rc 0) 00000100:00100000:0.0:1786960834.973330:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958326656:12345-192.168.203.23@tcp:101:bash.0 Request processed in 255us (6571us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960834.973338:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1786960834.977350:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960834.977528:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326784 00000100:00100000:1.0:1786960834.977538:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326784 00000100:00100000:1.0:1786960834.977604:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1786960834.977614:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:11354:x1873763958326784:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960834.977646:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960834.977663:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0d3 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.977694:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.977702:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786960834.977707:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960834.977712:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.977748:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960834.977761:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960834.977775:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967770496:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960834.977873:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681687cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960834.987895:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967770496:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960834.987932:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960834.987974:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92a00, rc 0) 00000100:00100000:2.0:1786960834.988037:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:11354:x1873763958326784:12345-192.168.203.23@tcp:101:bash.0 Request processed in 10423us (10696us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960834.993544:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960834.993637:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958326912 00000100:00100000:3.0:1786960834.993647:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958326912 00010000:00010000:3.0:1786960834.993687:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 8 pid: 6660 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960834.993720:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1786960834.993728:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1786960834.993729:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958326912:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960834.993758:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960834.993782:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.993796:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.993819:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f99205b/0x1808d16e4c97fed7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0cc expref: 7 pid: 6660 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.993853:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960834.993857:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960834.993865:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.993874:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960834.993909:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960834.993924:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967770624:192.168.203.23@tcp:105: 00000100:00100000:3.0:1786960834.994011:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960834.997795:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967770624:192.168.203.23@tcp:105: 00010000:00010000:0.0:1786960834.997824:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960834.997905:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958326912:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 4176us (4371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960834.997916:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:1.0:1786960835.002306:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.002366:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958327168 00000100:00100000:2.0:1786960835.002376:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958327168 00000100:00100000:2.0:1786960835.002430:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1786960835.002449:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11354:x1873763958327168:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1786960835.002797:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11354:x1873763958327168:12345-192.168.203.23@tcp:35:bash.0 Request processed in 349us (499us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1786960835.002805:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1786960835.147388:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.147511:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958327424 00000100:00100000:1.0:1786960835.147521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958327424 00000100:00100000:1.0:1786960835.147582:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:1.0:1786960835.147592:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11364:x1873763958327424:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960835.147639:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.147661:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0da expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960835.147778:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786960835.147906:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fee5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0da expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.147921:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:1.0:1786960835.147925:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786960835.147930:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97fee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0da expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.147942:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93e00, rc 0) 00000100:00100000:1.0:1786960835.148011:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11364:x1873763958327424:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 420us (630us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1786960835.148018:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 144 00000100:00100000:3.0:1786960835.155320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.155416:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958327680 00000100:00100000:2.0:1786960835.155426:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958327680 00000100:00100000:2.0:1786960835.155602:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1786960835.155624:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11364:x1873763958327680:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960835.155889:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11364:x1873763958327680:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 268us (705us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1786960835.158215:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1786960835.262379:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.262490:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958327808 00000100:00100000:1.0:1786960835.262500:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958327808 00000100:00100000:1.0:1786960835.262559:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:1.0:1786960835.262569:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11370:x1873763958327808:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960835.262592:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.262623:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0e1 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262691:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262723:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262737:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960835.262796:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1786960835.262800:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960835.262824:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262862:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97fef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e1 expref: 23 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262880:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e1 expref: 22 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.262889:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960835.262892:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960835.262895:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93000, rc 0) 00000100:00100000:1.0:1786960835.262961:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11370:x1873763958327808:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 394us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960835.262969:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:1.0:1786960835.270997:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.271106:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328064 00000100:00100000:2.0:1786960835.271115:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328064 00000100:00100000:2.0:1786960835.271209:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:2.0:1786960835.271230:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11370:x1873763958328064:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960835.271266:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960835.271287:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ff01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0e8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.271382:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ff08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.271395:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.271407:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ff08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960835.271417:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1786960835.271562:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ff01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e8 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.271584:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ff08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e8 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.271594:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:2.0:1786960835.271596:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960835.271600:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960835.271667:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:11370:x1873763958328064:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 449us (680us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1786960835.271674:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:2.0:1786960835.280427:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.280476:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.280620:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328192 00000100:00100000:0.0:1786960835.280629:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328192 00000100:00100000:0.0:1786960835.280691:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1786960835.280701:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:2343:x1873763958328192:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960835.280729:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960835.280753:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ff08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e8 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.280771:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:0.0:1786960835.280776:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960835.280833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:2343:x1873763958328192:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 133us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960835.280850:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960835.281060:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328448 00000100:00100000:1.0:1786960835.281065:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328448 00000100:00100000:1.0:1786960835.281101:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:1.0:1786960835.281109:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11370:x1873763958328448:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960835.281814:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.281832:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0ef expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.281943:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.281958:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.281969:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960835.281982:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786960835.282102:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0ef expref: 26 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.282119:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0ef expref: 25 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.282126:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:1.0:1786960835.282129:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786960835.282132:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92400, rc 0) 00000100:00100000:1.0:1786960835.288757:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:11370:x1873763958328448:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1075us (1706us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1786960835.288783:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:1.0:1786960835.296744:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960835.296851:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328576 00000100:00100000:3.0:1786960835.296873:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328576 00000100:00100000:3.0:1786960835.296944:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960835.296954:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958328576:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:3.0:1786960835.296995:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.297016:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.297023:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960835.297027:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960835.297031:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.297078:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.297092:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 6 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960835.297106:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967770752:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960835.297233:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646db4c00 going to sleep for 11 seconds 00000100:00080000:1.0:1786960835.297876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960835.302660:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967770752:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960835.302702:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.307464:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960835.307629:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328704 00000100:00100000:3.0:1786960835.307654:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328704 00002000:00100000:3.0:1786960835.307716:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9766813e5c00 x1873763958328704/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:421/0 lens 504/0 e 0 to 0 dl 1786960846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960835.307729:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766813e5c00 with x1873763958328704 ext(0->12) 00010000:00010000:3.0:1786960835.307751:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 7 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.307771:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 7 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960835.307780:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9766813e5c00 00000100:00100000:3.0:1786960835.307819:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1786960835.307829:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958328704:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:3.0:1786960835.309010:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958328704:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 1173us (1554us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1786960835.309021:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00002000:00100000:3.0:1786960835.309032:0:6663:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9766813e5c00 x1873763958328704/t4294967305(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:421/0 lens 504/448 e 0 to 0 dl 1786960846 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960835.309042:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766813e5c00 with x1873763958328704 ext(0->12) 00010000:00010000:3.0:1786960835.309051:0:6663:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960835.309080:0:6663:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960835.309094:0:6663:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9766813e5c00 00000100:00100000:3.0:1786960835.321942:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.322162:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958328832 00000100:00100000:0.0:1786960835.322175:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958328832 00010000:00010000:0.0:1786960835.322272:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960835.322325:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1786960835.322337:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2341:x1873763958328832:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960835.322358:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786960835.322382:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1786960835.322386:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786960835 00002000:00010000:0.0:1786960835.322388:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786960835 00002000:00010000:0.0:1786960835.322391:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786960835 00010000:00010000:0.0:1786960835.322398:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.322415:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.322466:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008624c4a0/0x1808d16e4c97fede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0d3 expref: 9 pid: 6658 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.322488:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960835.322494:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960835.322501:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.322512:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.322551:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960835.322625:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2341:x1873763958328832:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 289us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960835.322633:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00010000:00010000:2.0:1786960835.322718:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322729:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322760:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322769:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322777:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322785:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960835.322789:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322799:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322813:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.322829:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027c02c81/0x1808d16e4c97ff2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960835.322897:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2341:x1873763958328576:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 25945us (26162us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960835.322906:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:2.0:1786960835.344656:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.344768:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329088 00000100:00100000:0.0:1786960835.344781:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329088 00000100:00100000:0.0:1786960835.344865:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:0.0:1786960835.344878:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:11370:x1873763958329088:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:0.0:1786960835.344965:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0ef expref: 25 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960835.345352:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1786960835.345402:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1786960835.346013:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1786960835.346085:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.346113:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.346123:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.346169:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.346225:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 29 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960835.346243:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967770880:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960835.346368:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960835.349879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.350001:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967770880:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960835.350035:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.350339:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329216 00000100:00100000:1.0:1786960835.350348:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329216 00010000:00010000:1.0:1786960835.350394:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 30 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.350440:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1786960835.350451:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+30:2344:x1873763958329216:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960835.350468:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960835.350476:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 30 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350490:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 30 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350517:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c97fec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0c5 expref: 30 pid: 5810 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350538:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:1.0:1786960835.350543:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350554:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350563:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.350596:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960835.350668:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:2344:x1873763958329216:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 217us (803us total) trans 0 rc 0/0 00010000:00010000:0.0:1786960835.350682:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.350699:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.350703:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000001:00080000:0.0:1786960835.350886:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1786960835.351137:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1786960835.351303:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967771008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786960835.351367:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960835.351405:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976647acbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960835.351559:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771008 00000100:00100000:1.0:1786960835.351565:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771008 00000100:00100000:1.0:1786960835.351623:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786960835.351632:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967771008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786960835.351720:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967771008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960835.351727:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786960835.351775:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967771008:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1786960835.351876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1786960835.354651:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1786960835.354786:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967771136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960835.356175:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960835.356621:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960835.356730:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771136 00000100:00100000:3.0:1786960835.356741:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771136 00000100:00100000:3.0:1786960835.356901:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786960835.356939:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967771136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1786960835.357418:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1873763967771136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 480us (1245us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1786960835.357427:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960835.358552:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ae9f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967771136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1786960835.358714:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1786960835.358785:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359441:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359452:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359519:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960835.359525:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359552:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359574:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:2.0:1786960835.359577:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786960835.359583:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.359589:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ff32 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960835.360333:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786960835.360545:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1786960835.360559:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317387372100ns, next at 318387369025ns, rc = 0 00000001:00080000:2.0:1786960835.360570:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1786960835.360634:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976643e01800) 00010000:00010000:2.0:1786960835.360637:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786960835.360649:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c97ff1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0ef expref: 33 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960835.360815:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11370:x1873763958329088:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 15938us (16179us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1786960835.360826:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000020:00080000:2.0:1786960835.360832:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1786960835.368036:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.368248:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329344 00000100:00100000:1.0:1786960835.368261:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329344 00000100:00100000:1.0:1786960835.368339:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:1.0:1786960835.368351:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11370:x1873763958329344:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960835.368384:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.368414:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97ff39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0f6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.368505:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97ff39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0f6 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.368525:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97ff39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0f6 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.368560:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.368564:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786960835.368570:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92c00, rc 0) 00000100:00100000:1.0:1786960835.368651:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:11370:x1873763958329344:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 302us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960835.368677:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:1.0:1786960835.373528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.374031:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329600 00000100:00100000:2.0:1786960835.374047:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329600 00000100:00100000:2.0:1786960835.374134:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1786960835.374145:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+33:11370:x1873763958329600:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960835.374526:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11370:x1873763958329600:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 381us (1014us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1786960835.375862:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000001:00080000:2.0:1786960835.454778:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1786960835.454800:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1786960835.480688:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.480790:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329856 00000100:00100000:2.0:1786960835.480812:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329856 00000100:00100000:2.0:1786960835.480907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:2.0:1786960835.480920:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11380:x1873763958329856:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960835.480953:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960835.480984:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97ff40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c0fd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960835.481155:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786960835.481362:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97ff40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0fd expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.481381:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960835.481384:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960835.481392:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c97ff40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0fd expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960835.481408:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f600, rc 0) 00000100:00100000:2.0:1786960835.481489:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11380:x1873763958329856:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 571us (882us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1786960835.481497:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:3.0:1786960835.484702:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.488671:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958329984 00000100:00100000:1.0:1786960835.488696:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958329984 00000100:00100000:1.0:1786960835.488786:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:1.0:1786960835.488798:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11380:x1873763958329984:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:1.0:1786960835.489734:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.489758:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.489772:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.489791:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.489798:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.489805:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490562:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490575:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490583:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960835.490718:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490736:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490743:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490750:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490757:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.490762:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490770:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490784:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960835.490788:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.490793:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490800:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490816:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490822:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490834:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490849:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.490852:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490860:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490869:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496b00) 00010000:00010000:1.0:1786960835.490872:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.490875:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490881:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490898:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490904:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490920:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.490925:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.490928:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.491605:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.491796:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.491799:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.491803:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.491809:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.492254:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11380:x1873763958329984:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 3449us (7561us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960835.492267:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:3.0:1786960835.496562:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.496690:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958330240 00000100:00100000:0.0:1786960835.496704:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958330240 00000100:00100000:0.0:1786960835.496772:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:0.0:1786960835.496784:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11380:x1873763958330240:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960835.497388:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:11380:x1873763958330240:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 605us (837us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1786960835.497398:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1786960835.534901:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.535284:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958330496 00000100:00100000:1.0:1786960835.535296:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958330496 00000100:00100000:1.0:1786960835.535376:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:1.0:1786960835.535388:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:11383:x1873763958330496:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960835.535420:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.535448:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c104 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535559:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535576:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535590:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535626:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535634:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535641:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535823:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535833:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.535850:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960835.535863:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786960835.536493:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536506:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536514:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536521:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.536527:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536552:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536569:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960835.536573:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.536580:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536587:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ff6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536603:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536609:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536616:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536622:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.536625:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536631:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536639:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496b00) 00010000:00010000:1.0:1786960835.536642:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.536645:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536663:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536726:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 39 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536743:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 38 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.536751:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.536754:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960835.536757:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93a00, rc 0) 00000100:00100000:1.0:1786960835.536865:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11383:x1873763958330496:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1478us (1979us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1786960835.536873:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 151 00000100:00100000:3.0:1786960835.541027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.541229:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958330624 00000100:00100000:0.0:1786960835.541242:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958330624 00000100:00100000:0.0:1786960835.541311:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:0.0:1786960835.541323:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11383:x1873763958330624:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1786960835.541415:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541435:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541449:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541494:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541503:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541509:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541535:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960835.541540:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541548:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541561:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960835.541564:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960835.541569:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.541575:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ff86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960835.541682:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11383:x1873763958330624:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 360us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960835.541690:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 152 00000100:00100000:3.0:1786960835.544975:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960835.545173:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958330880 00000100:00100000:2.0:1786960835.545214:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958330880 00000100:00100000:2.0:1786960835.545282:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1786960835.545295:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11383:x1873763958330880:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960835.545615:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:11383:x1873763958330880:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 322us (653us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1786960835.545624:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00010000:00010000:3.0:1786960835.828604:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960835.851314:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.851426:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958331136 00000100:00100000:1.0:1786960835.851438:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958331136 00000100:00100000:1.0:1786960835.851535:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:1.0:1786960835.851547:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:11415:x1873763958331136:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:1.0:1786960835.851579:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960835.851608:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c10b expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.851744:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.851762:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.851795:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960835.851809:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786960835.852009:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ff8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c10b expref: 42 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.852032:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c10b expref: 41 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.852041:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.852045:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960835.852049:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92800, rc 0) 00000100:00100000:1.0:1786960835.852128:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11415:x1873763958331136:12345-192.168.203.23@tcp:101:cat.0 Request processed in 583us (828us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1786960835.852135:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 153 00000100:00100000:3.0:1786960835.861170:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960835.863983:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.864039:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958331264 00000100:00100000:0.0:1786960835.864056:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958331264 00000100:00100000:0.0:1786960835.864155:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1786960835.864165:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:2344:x1873763958331264:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960835.864180:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960835.864224:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c97ff94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c10b expref: 41 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.864247:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960835.864253:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960835.864257:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958331520 00000100:00100000:2.0:1786960835.864268:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958331520 00000100:00100000:0.0:1786960835.864345:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:2344:x1873763958331264:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 178us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960835.864357:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1786960835.864368:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:2.0:1786960835.864373:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11415:x1873763958331520:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1786960835.864680:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11415:x1873763958331520:12345-192.168.203.23@tcp:35:cat.0 Request processed in 312us (711us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1786960835.864688:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:3.0:1786960835.967166:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960835.967285:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958331776 00000100:00100000:0.0:1786960835.967303:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958331776 00000100:00100000:0.0:1786960835.967388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:0.0:1786960835.967399:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11421:x1873763958331776:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:0.0:1786960835.967430:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960835.967434:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786960835.967468:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c97fefa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0e1 expref: 41 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.967833:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960835.967849:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960835.967870:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ffa2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c112 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.968008:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.968025:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 41 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.968035:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.968079:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 41 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.968119:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 41 pid: 8734 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960835.968139:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967771264:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960835.968394:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960835.970034:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967771264:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960835.970127:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960835.970615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.970794:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958331904 00000100:00100000:1.0:1786960835.970804:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958331904 00010000:00010000:1.0:1786960835.970858:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 42 pid: 8734 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.970904:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1786960835.970914:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+42:2343:x1873763958331904:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960835.970935:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960835.970942:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 42 pid: 8734 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.970976:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 42 pid: 8734 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.971003:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ff78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c104 expref: 42 pid: 8734 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.971022:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.971027:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.971038:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.971047:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.971084:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960835.971141:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:2343:x1873763958331904:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 228us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960835.971149:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00010000:00010000:0.0:1786960835.971266:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.971283:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960835.971305:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1786960835.971524:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c97ffa2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.971556:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960835.971565:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960835.971568:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960835.971571:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169000, rc 0) 00000100:00100000:0.0:1786960835.971599:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11421:x1873763958331776:12345-192.168.203.23@tcp:101:dd.0 Request processed in 4203us (4444us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1786960835.971619:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 154 00000100:00100000:3.0:1786960835.975452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960835.975700:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958332160 00000100:00100000:1.0:1786960835.975715:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958332160 00000100:00100000:1.0:1786960835.975785:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 155 00000100:00100000:1.0:1786960835.975796:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+41:11421:x1873763958332160:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:1.0:1786960835.976172:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.976224:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.976259:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786960835.976331:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1786960835.976360:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000367749e1 reply state 0000000029303c6c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960835.976371:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960835.976493:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681637b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:11421:x1873763958332160:12345-192.168.203.23@tcp:36:dd.0 Request processed in 687us (1044us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1786960835.976502:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 155 00000020:00080000:1.0:1786960835.976511:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786960835.984016:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.984057:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.984348:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.984357:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960835.984363:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.986564:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.986595:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960835.986598:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960835.986621:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960835.986629:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960836.274766:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960836.275513:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958332288 00000100:00100000:1.0:1786960836.275528:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958332288 00000100:00100000:1.0:1786960836.275632:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:1.0:1786960836.275645:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+43:11435:x1873763958332288:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:1.0:1786960836.275675:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960836.275703:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c119 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275793:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275810:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275823:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275850:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275858:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.275865:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.276013:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.276026:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.276047:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.276240:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.276258:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 44 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960836.276274:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967771392:192.168.203.23@tcp:104: 00000100:00080000:0.0:1786960836.276439:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960836.276509:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766816873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960836.280569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.280710:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967771392:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960836.280743:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.280847:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958332544 00000100:00100000:0.0:1786960836.280857:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958332544 00000100:00100000:0.0:1786960836.280925:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:0.0:1786960836.280935:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+45:5580:x1873763958332544:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1786960836.282541:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:5580:x1873763958332544:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 1595us (1977us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1786960836.282559:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1786960836.288123:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960836.288300:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958332672 00000100:00100000:0.0:1786960836.288314:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958332672 00010000:00010000:0.0:1786960836.288373:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 46 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.288427:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:0.0:1786960836.288439:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:2343:x1873763958332672:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960836.288472:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960836.288481:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 46 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288497:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 46 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288525:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c97ffa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c112 expref: 46 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288581:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960836.288587:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288614:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288623:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.288658:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960836.288732:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+45:2343:x1873763958332672:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 295us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960836.288740:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00010000:00010000:2.0:1786960836.289232:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289243:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960836.289302:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1786960836.289308:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960836.289341:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289372:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289384:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289392:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289399:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289406:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960836.289411:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289419:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289431:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960836.289435:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960836.289439:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289445:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c97ffc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289458:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289465:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289477:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289482:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960836.289485:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289492:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289500:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496b00) 00010000:00010000:2.0:1786960836.289503:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960836.289506:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289512:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c97ffcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289560:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c97ffbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c119 expref: 45 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289577:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c119 expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.289584:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960836.289586:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960836.289602:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93e00, rc 0) 00000100:00100000:2.0:1786960836.289662:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:11435:x1873763958332288:12345-192.168.203.23@tcp:101:stat.0 Request processed in 14021us (14911us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.289679:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 156 00000100:00100000:0.0:1786960836.356503:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960836.356695:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958332928 00000100:00100000:1.0:1786960836.356709:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958332928 00000100:00100000:1.0:1786960836.356787:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 157 00000100:00100000:1.0:1786960836.356800:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:11441:x1873763958332928:12345-192.168.203.23@tcp:36:truncate.0 00010000:00010000:1.0:1786960836.356888:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960836.356923:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c97ffd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c119 expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.356948:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960836.356972:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960836.357599:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.357617:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.357629:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786960836.357690:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1786960836.357717:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e768db30 reply state 0000000021bd8d31 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960836.357727:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960836.357860:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:11441:x1873763958332928:12345-192.168.203.23@tcp:36:truncate.0 Request processed in 1060us (1369us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1786960836.357869:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 157 00000020:00080000:1.0:1786960836.357875:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786960836.365692:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365715:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365724:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365732:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960836.365760:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365769:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365791:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:3.0:1786960836.365794:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960836.365800:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960836.365807:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c97ffda lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960836.406248:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786960836.406279:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967771520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960836.406372:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.406931:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967771776:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.406973:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.406999:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960836.407005:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967771904:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407028:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.407058:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967771648:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.407120:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967772160:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407146:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.407167:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960836.407172:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967772032:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407215:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960836.407249:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771648 00000100:00100000:2.0:1786960836.407259:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771648 00000100:00100000:2.0:1786960836.407311:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1786960836.407321:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967771648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407378:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3286:x1873763967771648:12345-0@lo:400:kworker.0 Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.407386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1786960836.407428:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967772160 00000100:00100000:2.0:1786960836.407433:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967772160 00000100:00100000:2.0:1786960836.407474:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786960836.407482:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967772160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407520:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967772160:12345-0@lo:400:kworker.0 Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.407545:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1786960836.407593:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967771648:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407605:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1786960836.407622:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1786960836.407646:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967772160:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407678:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771776 00000100:00100000:2.0:1786960836.407682:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771776 00000100:00100000:2.0:1786960836.407705:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771904 00000100:00100000:2.0:1786960836.407708:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771904 00000100:00100000:2.0:1786960836.407729:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967772032 00000100:00100000:2.0:1786960836.407732:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967772032 00000100:00100000:2.0:1786960836.407745:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1786960836.407751:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967771776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407795:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967771776:12345-0@lo:400:kworker.0 Request processed in 44us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.407801:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1786960836.407813:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1786960836.407820:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967771904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407863:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967771904:12345-0@lo:400:kworker.0 Request processed in 44us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.407882:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1786960836.407895:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1786960836.407901:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967772032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407937:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967772032:12345-0@lo:400:kworker.0 Request processed in 36us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.407952:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1786960836.407978:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967771904:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.407987:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967771776:0@lo:400:kworker.0 00000100:00100000:2.0:1786960836.408011:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967772032:0@lo:400:kworker.0 00000100:00100000:0.0:1786960836.409039:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967771520 00000100:00100000:0.0:1786960836.409050:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967771520 00000100:00100000:0.0:1786960836.409124:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786960836.409135:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967771520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960836.409180:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960836.409286:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967771520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2914us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960836.409294:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1786960836.409321:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960836.409333:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960836.409370:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967771520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960836.526501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.530233:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958333056 00000100:00100000:2.0:1786960836.530254:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958333056 00000100:00100000:2.0:1786960836.530374:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:2.0:1786960836.530386:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+45:11455:x1873763958333056:12345-192.168.203.23@tcp:101:stat.0 00010000:00010000:2.0:1786960836.530429:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960836.530459:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97ffe1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c120 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530569:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530587:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530600:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530616:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530623:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530629:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530790:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530800:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530808:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960836.530862:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1786960836.530868:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960836.530892:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530905:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530915:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530921:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530928:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530936:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960836.530941:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530950:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530972:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960836.530975:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960836.530981:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.530988:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c97ffe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531004:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531011:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531018:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531024:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960836.531026:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531032:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531040:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976664f8c800) 00010000:00010000:2.0:1786960836.531042:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960836.531045:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531052:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c97ffef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531103:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97ffe1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 47 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531119:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 46 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.531128:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960836.531130:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960836.531133:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fc00, rc 0) 00000100:00100000:2.0:1786960836.531287:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:11455:x1873763958333056:12345-192.168.203.23@tcp:101:stat.0 Request processed in 902us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.531295:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 158 00000100:00100000:0.0:1786960836.639593:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.641504:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958333312 00000100:00100000:2.0:1786960836.641524:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958333312 00000100:00100000:2.0:1786960836.641630:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:2.0:1786960836.641643:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+46:11465:x1873763958333312:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960836.641673:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960836.641704:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c127 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960836.641871:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786960836.642039:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fffd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c127 expref: 48 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.642057:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960836.642071:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960836.642094:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c97fffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c127 expref: 48 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.642113:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e600, rc 0) 00000100:00100000:2.0:1786960836.642831:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:11465:x1873763958333312:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1187us (3246us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1786960836.642849:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 159 00000100:00100000:1.0:1786960836.649681:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.649764:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958333568 00000100:00100000:2.0:1786960836.649778:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958333568 00000100:00100000:2.0:1786960836.649855:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1786960836.649868:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:11465:x1873763958333568:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960836.650254:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+48:11465:x1873763958333568:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 387us (586us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1786960836.650264:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1786960836.736352:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.736494:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958333824 00000100:00100000:2.0:1786960836.736511:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958333824 00000100:00100000:0.0:1786960836.736637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:0.0:1786960836.736657:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+48:11471:x1873763958333824:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960836.736701:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960836.736727:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c98000b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c12e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.736874:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.736893:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.736903:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.736946:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.736963:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 49 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.736982:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967772288:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960836.737119:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766522bccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960836.738811:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e525f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967772288:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960836.738860:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.746731:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960836.747080:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958333952 00000100:00100000:1.0:1786960836.747093:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958333952 00010000:00010000:1.0:1786960836.747147:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 50 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960836.747234:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:1.0:1786960836.747246:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:2343:x1873763958333952:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960836.747266:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960836.747274:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 50 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747312:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 50 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747342:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c97fff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c120 expref: 50 pid: 5812 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747361:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960836.747368:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747379:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747388:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.747422:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960836.747496:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:2343:x1873763958333952:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 251us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960836.747504:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00010000:00010000:0.0:1786960836.748103:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.748114:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960836.748138:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1786960836.748379:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c98000b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 50 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.748426:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 49 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.748435:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960836.748439:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960836.748442:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:0.0:1786960836.748543:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:11471:x1873763958333824:12345-192.168.203.23@tcp:101:bash.0 Request processed in 11894us (12207us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1786960836.748552:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 160 00000100:00100000:0.0:1786960836.753079:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960836.753151:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958334208 00000100:00100000:1.0:1786960836.753164:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958334208 00000100:00100000:1.0:1786960836.753280:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 161 00000100:00100000:1.0:1786960836.753292:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:11471:x1873763958334208:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:1.0:1786960836.753825:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.753856:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.753878:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786960836.753940:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1786960836.753966:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebe246ad reply state 00000000afd57d50 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960836.753977:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960836.754091:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11471:x1873763958334208:12345-192.168.203.23@tcp:36:bash.0 Request processed in 800us (1025us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1786960836.754100:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 161 00000020:00080000:1.0:1786960836.754105:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786960836.759350:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759374:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759384:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759392:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960836.759398:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759407:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759439:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960836.759443:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960836.759467:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.759475:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980020 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.774637:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.777675:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958334336 00000100:00100000:2.0:1786960836.777693:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958334336 00000100:00100000:2.0:1786960836.777863:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1786960836.777876:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:11471:x1873763958334336:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960836.777909:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960836.777939:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980027 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c135 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.778051:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.778081:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.778110:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.778153:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.778168:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 52 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960836.778206:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967772416:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960836.778323:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ad0b540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960836.781792:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960836.781950:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958334464 00000100:00100000:0.0:1786960836.781962:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958334464 00010000:00010000:0.0:1786960836.782013:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 53 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960836.782072:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:0.0:1786960836.782103:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:2343:x1873763958334464:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960836.782122:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960836.782130:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 53 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.782146:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 53 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.782175:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960836.782182:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.782229:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.782238:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.782261:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960836.782323:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:2343:x1873763958334464:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 222us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960836.782331:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00010000:00010000:2.0:1786960836.784007:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980012 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c12e expref: 52 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960836.784054:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967772416:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960836.784095:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.784106:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.784114:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960836.784182:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1786960836.784256:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960836.784289:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.784358:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980027 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c135 expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.784377:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c135 expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.784388:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960836.784391:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960836.784395:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960836.784494:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:11471:x1873763958334336:12345-192.168.203.23@tcp:101:bash.0 Request processed in 6620us (9873us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960836.784504:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:3.0:1786960836.787792:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.788402:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958334720 00000100:00100000:2.0:1786960836.788518:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958334720 00000100:00100000:2.0:1786960836.788698:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960836.788711:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:11471:x1873763958334720:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:2.0:1786960836.789031:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11471:x1873763958334720:12345-192.168.203.23@tcp:35:bash.0 Request processed in 322us (1252us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1786960836.789040:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00010000:00010000:2.0:1786960836.852355:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786960836.918946:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318945755509ns, next at 319945752687ns, rc = 0 00000100:00100000:1.0:1786960836.919411:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786960836.919442:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967772544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960836.919537:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960836.919871:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967772544 00000100:00100000:0.0:1786960836.919880:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967772544 00000100:00100000:0.0:1786960836.919950:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786960836.919962:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967772544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960836.919993:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1786960836.920097:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967772544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960836.920106:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786960836.921280:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967772544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960836.935762:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960836.935965:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958334976 00000100:00100000:2.0:1786960836.935979:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958334976 00000100:00100000:2.0:1786960836.936066:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:2.0:1786960836.936087:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11481:x1873763958334976:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960836.936142:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960836.936171:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980035 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c13c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960836.936377:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786960836.936598:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980035 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c13c expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.936616:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960836.936620:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960836.936626:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980035 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c13c expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960836.936642:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e600, rc 0) 00000100:00100000:2.0:1786960836.937066:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:11481:x1873763958334976:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 974us (1310us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1786960836.937075:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1786960836.956351:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960836.956890:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958335104 00000100:00100000:0.0:1786960836.956903:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958335104 00000100:00100000:0.0:1786960836.956985:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:0.0:1786960836.956998:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:11481:x1873763958335104:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1786960836.957161:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957240:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957258:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957279:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957287:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957294:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.957436:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.958290:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960836.958319:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960836.959264:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959287:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959294:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959301:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959307:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960836.959312:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959320:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959336:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960836.959339:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960836.959345:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959381:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980043 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959430:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959437:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959443:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959592:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960836.959595:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959602:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959795:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559deb00) 00010000:00010000:1.0:1786960836.959798:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960836.959802:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959808:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98004a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959841:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959848:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959862:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959868:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960836.959871:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959878:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959887:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960836.959889:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960836.959892:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960836.959898:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960836.960039:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:11481:x1873763958335104:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 3037us (3698us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960836.960050:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 164 00000100:00100000:3.0:1786960836.963641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960836.963989:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958335360 00000100:00100000:0.0:1786960836.964002:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958335360 00000100:00100000:0.0:1786960836.964081:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:0.0:1786960836.964093:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+53:11481:x1873763958335360:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960836.964475:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11481:x1873763958335360:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 383us (847us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1786960836.964483:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:3.0:1786960837.071086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960837.072587:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958335616 00000100:00100000:1.0:1786960837.072618:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958335616 00000100:00100000:1.0:1786960837.072720:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:1.0:1786960837.072734:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11484:x1873763958335616:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960837.072766:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960837.072795:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980058 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c143 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072926:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072943:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072959:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072975:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072983:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.072990:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073399:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98006d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073409:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98006d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073417:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98006d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960837.073428:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1786960837.073918:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073928:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073945:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073952:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960837.073957:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073965:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073981:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960837.073985:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960837.073990:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.073996:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98005f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074013:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074020:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074026:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074031:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960837.074034:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074050:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074320:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496600) 00010000:00010000:1.0:1786960837.074323:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960837.074328:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074335:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074396:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c980058 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c143 expref: 57 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074412:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98006d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c143 expref: 56 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.074420:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960837.074422:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786960837.074425:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93400, rc 0) 00000100:00100000:1.0:1786960837.074838:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:11484:x1873763958335616:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2095us (3765us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1786960837.074848:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 165 00000100:00100000:3.0:1786960837.084601:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960837.084768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958335744 00000100:00100000:2.0:1786960837.084781:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958335744 00000100:00100000:2.0:1786960837.084865:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:2.0:1786960837.084877:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:11484:x1873763958335744:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1786960837.085021:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085043:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085067:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085124:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085132:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085141:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085148:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960837.085153:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085162:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085178:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960837.085181:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960837.085222:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.085230:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98007b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960837.085325:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:11484:x1873763958335744:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 449us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960837.085333:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:3.0:1786960837.086037:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960837.086131:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958335872 00000100:00100000:1.0:1786960837.086142:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958335872 00000100:00100000:1.0:1786960837.086225:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1786960837.086236:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:2342:x1873763958335872:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960837.086267:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960837.086292:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98006d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c143 expref: 56 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.086309:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:1.0:1786960837.086314:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960837.086350:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:2342:x1873763958335872:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 117us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960837.086357:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1786960837.094284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960837.094378:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958336128 00000100:00100000:0.0:1786960837.094391:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958336128 00000100:00100000:0.0:1786960837.094469:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:0.0:1786960837.094481:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:11484:x1873763958336128:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960837.094809:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:11484:x1873763958336128:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 329us (547us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1786960837.094818:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1786960837.279475:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960837.279725:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958336384 00000100:00100000:2.0:1786960837.279737:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958336384 00000100:00100000:2.0:1786960837.279896:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:2.0:1786960837.279909:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:11502:x1873763958336384:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:2.0:1786960837.279944:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960837.279974:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980082 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c14a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.280121:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980089 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.280139:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980089 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.280154:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980089 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960837.280168:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1786960837.280364:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c14a expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.280387:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980089 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c14a expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.280397:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:2.0:1786960837.280410:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786960837.280416:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ea00, rc 0) 00000100:00100000:2.0:1786960837.280507:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11502:x1873763958336384:12345-192.168.203.23@tcp:101:cat.0 Request processed in 601us (1105us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1786960837.280515:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:3.0:1786960837.302181:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960837.302354:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958336512 00000100:00100000:2.0:1786960837.302387:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958336512 00000100:00100000:2.0:1786960837.302471:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:2.0:1786960837.302484:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11503:x1873763958336512:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960837.302517:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960837.302547:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c151 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302671:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302687:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302701:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960837.302783:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1786960837.302789:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960837.302817:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302861:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c151 expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302882:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c151 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960837.302893:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960837.302896:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786960837.302900:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fe00, rc 0) 00000100:00100000:2.0:1786960837.302984:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11503:x1873763958336512:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 502us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960837.302991:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 168 00000100:00100000:3.0:1786960837.309225:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960837.309328:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958336896 00000100:00100000:0.0:1786960837.309342:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958336896 00000100:00100000:0.0:1786960837.309415:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1786960837.309426:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11503:x1873763958336896:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960837.310009:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11503:x1873763958336896:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 584us (827us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1786960837.310019:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1786960837.311759:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960837.311960:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337024 00000100:00100000:0.0:1786960837.311972:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337024 00000100:00100000:0.0:1786960837.312062:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:0.0:1786960837.312073:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11503:x1873763958337024:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:0.0:1786960837.312100:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786960837.312131:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98002e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c135 expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.312174:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980089 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c14a expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.312239:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c97ff39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0f6 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.312253:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496d00) 00010000:00010000:0.0:1786960837.312265:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960837.312334:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11503:x1873763958337024:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 262us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960837.312343:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1786960837.314022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960837.314120:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337152 00000100:00100000:1.0:1786960837.314131:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337152 00000100:00100000:1.0:1786960837.314237:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:1.0:1786960837.314249:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11503:x1873763958337152:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:1.0:1786960837.314407:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.314426:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960837.314439:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960837.315256:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1786960837.315369:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11503:x1873763958337152:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 1120us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960837.315379:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 169 00000100:00100000:2.0:1786960837.340284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960837.340369:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337280 00000100:00100000:0.0:1786960837.340383:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337280 00000100:00100000:0.0:1786960837.340468:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 170 00000100:00100000:0.0:1786960837.340480:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11505:x1873763958337280:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960837.340506:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960837.340535:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c158 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340620:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340637:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340671:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340688:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340695:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340702:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340838:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340848:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340855:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960837.340900:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786960837.340909:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960837.340932:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340945:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340955:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340972:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340980:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.340987:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960837.340992:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341002:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341017:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960837.341020:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960837.341025:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341031:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c9800b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341073:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341080:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341086:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341090:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960837.341103:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341110:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341118:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559dec00) 00010000:00010000:0.0:1786960837.341121:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960837.341123:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341130:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9800ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341178:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 59 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341258:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960837.341266:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:0.0:1786960837.341269:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960837.341272:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97666c6e0000, rc 0) 00000100:00100000:0.0:1786960837.341344:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11505:x1873763958337280:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 867us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960837.341352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 170 00010000:00010000:2.0:1786960837.876406:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786960838.040522:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1786960838.040772:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1786960838.040928:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1786960838.040941:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97666574a6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1786960838.040953:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976677835500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97666574a180 00000020:00080000:0.0:1786960838.040957:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976677835800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97667ae0a400 00000020:00080000:0.0:1786960838.040983:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1786960838.041013:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967772672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786960838.041170:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1786960838.041213:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1786960838.041236:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967772672 00000100:00100000:0.0:1786960838.041244:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967772672 00000100:00100000:0.0:1786960838.041312:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786960838.041322:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967772672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786960838.041354:0:6660:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1786960838.041396:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a82dbc3, atime: 0x6a82dbc3, ctime: 0x6a82dbc3, blocks: 0xb 00010000:00010000:0.0:1786960838.041406:0:6660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.041426:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1786960838.041431:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960838.041438:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.041455:0:6660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.041465:0:6660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.041475:0:6660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.042278:0:6660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786960838.043141:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1873763967772672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1815us (1967us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786960838.043153:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1786960838.043211:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766770fc700/2, rc 0, transno 4294967307 00000100:00080000:0.0:1786960838.043214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960838.043221:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967772672:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1786960838.043231:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960838.043242:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.043255:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960838.043260:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.043271:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.043293:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.043300:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9e11c6b/0x1808d16e4c9800c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.043322:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960838.043324:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960838.043326:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786960838.078333:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960838.078347:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786960838.078444:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1786960838.078452:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786960838.078626:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967772800:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786960838.078753:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766816873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960838.093387:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967772800:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786960838.098142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.098745:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337408 00000100:00100000:3.0:1786960838.098758:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337408 00000100:00080000:0.0:1786960838.098800:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960838.098858:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1786960838.098873:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11516:x1873763958337408:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786960838.098915:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786960838.099062:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11516:x1873763958337408:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 182us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.099072:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:0.0:1786960838.112368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.112414:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337536 00000100:00100000:0.0:1786960838.112426:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337536 00000100:00100000:0.0:1786960838.112498:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:0.0:1786960838.112519:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11516:x1873763958337536:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786960838.112633:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.112654:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.112669:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116619:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116644:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116658:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116697:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116706:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116714:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960838.116772:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786960838.116777:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960838.116791:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116804:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116812:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116820:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116838:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960838.116842:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116850:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.116865:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960838.118131:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960838.118141:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118281:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9800cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118299:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118322:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118329:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118334:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960838.118337:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118343:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118355:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9766559deb00) 00010000:00010000:0.0:1786960838.118357:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960838.118360:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118366:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9800d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118382:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118388:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118393:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118397:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960838.118407:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118412:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118420:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:0.0:1786960838.118422:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960838.118425:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.118431:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960838.118697:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11516:x1873763958337536:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 6176us (6337us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960838.118708:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000040:00080000:0.0:1786960838.125859:0:12481:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960838.126352:0:12481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960838.126404:0:12481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786960838.126414:0:12481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786960838.140877:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.145036:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337792 00000100:00100000:3.0:1786960838.145049:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337792 00000100:00100000:3.0:1786960838.145112:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:3.0:1786960838.145121:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+16:11516:x1873763958337792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960838.145139:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960838.145159:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c9800e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c15f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145270:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145285:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145296:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960838.145307:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1786960838.145491:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145513:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145519:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145526:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960838.145530:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145537:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145549:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:3.0:1786960838.145552:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960838.145556:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145562:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9800eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145599:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c9800e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c15f expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145609:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:3.0:1786960838.145612:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786960838.145615:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c9800e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c15f expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.145624:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:3.0:1786960838.145700:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958337792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 579us (4837us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1786960838.145707:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:3.0:1786960838.149604:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.149700:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958337920 00000100:00100000:1.0:1786960838.149710:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958337920 00000100:00100000:1.0:1786960838.149804:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:1.0:1786960838.149814:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958337920:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786960838.149856:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786960838.149961:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958337920:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.149969:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:2.0:1786960838.175733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.176086:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958338176 00000100:00100000:0.0:1786960838.176103:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958338176 00000100:00100000:0.0:1786960838.176178:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:0.0:1786960838.176208:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958338176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960838.176236:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960838.176239:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786960838.176274:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98009e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c151 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.176318:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960838.176324:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960838.176341:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c166 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786960838.179427:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1786960838.179801:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980100 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.179839:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.179857:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980100 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.179954:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c9800f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c166 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.180089:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980100 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c166 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.180101:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9766559deb00) 00010000:00010000:0.0:1786960838.180104:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960838.180108:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168c00, rc 0) 00000100:00100000:0.0:1786960838.180379:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958338176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4189us (4650us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1786960838.180391:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 175 00000100:00100000:0.0:1786960838.190344:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.193767:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958338432 00000100:00100000:1.0:1786960838.193784:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958338432 00000100:00100000:1.0:1786960838.193871:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:1.0:1786960838.193884:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958338432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786960838.193945:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960838.193972:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980100 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c166 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194002:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9766559deb00) 00010000:00010000:1.0:1786960838.194015:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960838.194040:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194053:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194080:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194095:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194102:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194108:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194402:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194411:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194418:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194425:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.194429:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194450:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194460:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960838.194463:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960838.194467:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194479:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c98010e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194500:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194507:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194514:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194519:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.194522:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194528:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194536:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x431ec4 (ffff976661496300) 00010000:00010000:1.0:1786960838.194539:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960838.194542:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.194548:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980115 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x431ec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.194645:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958338432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 762us (4310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786960838.194653:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:3.0:1786960838.209029:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.210352:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958338560 00000100:00100000:1.0:1786960838.210367:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958338560 00000100:00100000:1.0:1786960838.210443:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:1.0:1786960838.210455:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958338560:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960838.210474:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960838.210496:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c98011c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c16d expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210533:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210545:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210557:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210651:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c98011c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 19 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210668:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.210676:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:1.0:1786960838.210679:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786960838.210682:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93a00, rc 0) 00000100:00100000:1.0:1786960838.210747:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958338560:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 295us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.210754:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:2.0:1786960838.222586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.222665:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958338816 00000100:00100000:1.0:1786960838.222673:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958338816 00000100:00100000:1.0:1786960838.222731:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:1.0:1786960838.222742:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958338816:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786960838.222832:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.222849:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.222862:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960838.223136:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1786960838.223146:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320249959333ns, next at 321249956765ns, rc = 0 00000004:00010000:1.0:1786960838.223266:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3e9c1a1 reply state 000000006174498a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.223276:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960838.223365:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11516:x1873763958338816:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 623us (786us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1786960838.223372:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 178 00000100:00100000:3.0:1786960838.234319:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:3.0:1786960838.234353:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234365:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234373:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234380:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960838.234385:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234392:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234408:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:3.0:1786960838.234412:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960838.234416:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234423:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c98012a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960838.234450:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958338944 00000100:00100000:3.0:1786960838.234466:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958338944 00000100:00100000:3.0:1786960838.234526:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 179 00000100:00100000:3.0:1786960838.234535:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11516:x1873763958338944:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960838.234556:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960838.234571:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c174 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234626:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 20 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234639:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 20 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.234659:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:3.0:1786960838.234662:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960838.234665:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:3.0:1786960838.234718:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11516:x1873763958338944:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 184us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.234724:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 179 00000100:00100000:3.0:1786960838.239936:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.240019:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958339072 00000100:00100000:1.0:1786960838.240028:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958339072 00000100:00100000:1.0:1786960838.240112:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1786960838.240122:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958339072:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1786960838.240457:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958339072:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 335us (529us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1786960838.240466:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00080000:3.0:1786960838.240572:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960838.257892:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.257929:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958339328 00000100:00100000:3.0:1786960838.257938:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958339328 00000100:00100000:3.0:1786960838.257987:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960838.257997:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11516:x1873763958339328:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786960838.258250:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11516:x1873763958339328:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 254us (367us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1786960838.258269:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1786960838.265536:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.265647:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958339584 00000100:00100000:1.0:1786960838.265657:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958339584 00000100:00100000:1.0:1786960838.265717:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:1.0:1786960838.265727:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11516:x1873763958339584:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786960838.265835:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11516:x1873763958339584:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.265843:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 180 00000100:00100000:3.0:1786960838.271331:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960838.271481:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958339712 00000100:00100000:2.0:1786960838.271498:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958339712 00000100:00100000:2.0:1786960838.271552:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:2.0:1786960838.271563:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11516:x1873763958339712:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960838.271583:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960838.271605:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c17b expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271672:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271686:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271698:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960838.271747:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960838.271766:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271795:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c17b expref: 23 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271810:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c17b expref: 22 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.271819:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:2.0:1786960838.271834:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786960838.271839:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fe00, rc 0) 00000100:00100000:2.0:1786960838.271891:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958339712:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 330us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.271898:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 181 00000100:00100000:3.0:1786960838.275734:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.275806:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958339840 00000100:00100000:0.0:1786960838.275816:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958339840 00000100:00100000:0.0:1786960838.275884:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:0.0:1786960838.275894:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958339840:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960838.275911:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960838.275929:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c182 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960838.275955:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a82dbc6, blocks: 0x1 00010000:00010000:0.0:1786960838.275974:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1786960838.275979:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960838.275987:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.276004:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.276018:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682169000, rc 0) 00000100:00100000:0.0:1786960838.276072:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958339840:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 180us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960838.276079:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1786960838.286299:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.286388:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340096 00000100:00100000:0.0:1786960838.286397:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340096 00000100:00100000:0.0:1786960838.286452:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1786960838.286462:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958340096:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960838.286582:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958340096:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960838.286590:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 182 00000100:00100000:0.0:1786960838.291344:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.294965:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340224 00000100:00100000:1.0:1786960838.294976:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340224 00000100:00100000:1.0:1786960838.295036:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1786960838.295046:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:11516:x1873763958340224:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960838.295070:0:8239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960838.295089:0:8239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c189 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.295119:0:8239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.295129:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960838.295133:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960838.295138:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.295170:0:8239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.295224:0:8239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 9 pid: 6659 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.295239:0:8239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8239:1873763967772928:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960838.295333:0:8239:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681687840 going to sleep for 11 seconds 00000100:00100000:3.0:1786960838.300687:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960838.300757:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340352 00000100:00100000:2.0:1786960838.300766:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340352 00010000:00010000:2.0:1786960838.300807:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 10 pid: 6659 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960838.300856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1786960838.300866:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2344:x1873763958340352:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960838.300881:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960838.300907:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 10 pid: 6659 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.300939:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 10 pid: 6659 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.300966:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960838.300971:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960838.300980:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 10 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.300991:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 10 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.301028:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 10 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960838.301042:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5797:1873763967773056:192.168.203.23@tcp:105: 00000100:00100000:2.0:1786960838.301138:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766654cf3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1786960838.301488:0:8239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c980146 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c182 expref: 10 pid: 6659 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.301520:0:8239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8239:1873763967772928:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960838.301545:0:8239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.301555:0:8239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93000, rc 0) 00000100:00100000:1.0:1786960838.301587:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:11516:x1873763958340224:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 6544us (10253us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.301595:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1786960838.309342:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5797:1873763967773056:192.168.203.23@tcp:105: 00010000:00010000:1.0:1786960838.309369:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960838.309431:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958340352:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 8566us (8755us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.309442:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1786960838.310015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.320603:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340480 00000100:00100000:3.0:1786960838.320617:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340480 00002000:00100000:3.0:1786960838.320672:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff976647b47800 x1873763958340480/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:424/0 lens 504/0 e 0 to 0 dl 1786960849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960838.320684:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff976647b47800 with x1873763958340480 ext(0->8) 00002000:00010000:3.0:1786960838.320689:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff976647b47800 00000100:00100000:3.0:1786960838.320725:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1786960838.320736:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958340480:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1786960838.321224:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2344:x1873763958340480:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 488us (11208us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786960838.321232:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00002000:00100000:3.0:1786960838.321239:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff976647b47800 x1873763958340480/t4294967314(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:424/0 lens 504/448 e 0 to 0 dl 1786960849 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960838.321247:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff976647b47800 with x1873763958340480 ext(0->8) 00002000:00010000:3.0:1786960838.321251:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff976647b47800 00000100:00100000:0.0:1786960838.327411:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960838.328162:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340608 00000100:00100000:2.0:1786960838.328173:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340608 00000100:00100000:2.0:1786960838.328257:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 183 00000100:00100000:2.0:1786960838.328267:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958340608:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1786960838.429818:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958340608:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 101541us (102406us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.429841:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 183 00000001:00080000:2.0:1786960838.429873:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:2.0:1786960838.429896:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1786960838.429908:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1786960838.429913:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:2.0:1786960838.429933:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1786960838.429945:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1786960838.429954:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1786960838.430168:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967773184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786960838.430232:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960838.431818:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967773184 00000100:00100000:3.0:1786960838.431839:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967773184 00000100:00100000:3.0:1786960838.431926:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786960838.431937:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967773184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786960838.432103:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786960838.432116:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786960838 00002000:00010000:3.0:1786960838.432119:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786960838.432121:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786960838 -> 1786960838 00002000:00010000:3.0:1786960838.432124:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1786960838.432160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960838.432200:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1873763967773184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (1951us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1786960838.432208:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1786960838.432214:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff976650f00e00/2, rc 0, transno 4294967315 00000100:00100000:0.0:1786960838.432221:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976650f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967773184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1786960838.439301:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.439613:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340736 00000100:00100000:3.0:1786960838.439625:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340736 00000100:00100000:3.0:1786960838.439684:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1786960838.439694:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2343:x1873763958340736:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1786960838.510029:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2343:x1873763958340736:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 70328us (70729us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.510043:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000001:00080000:0.0:1786960838.510480:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1786960838.510502:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1786960838.510508:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1786960838.513482:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.513741:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958340992 00000100:00100000:1.0:1786960838.513751:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958340992 00000100:00100000:1.0:1786960838.513833:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:1.0:1786960838.513843:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958340992:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786960838.513897:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960838.513936:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c98013f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c17b expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.513954:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:1.0:1786960838.513959:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960838.513987:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.514000:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.514009:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960838.514298:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6bca4ed reply state 00000000c02471be transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.514309:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960838.514408:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11516:x1873763958340992:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 566us (935us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1786960838.514415:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 184 00000100:00100000:1.0:1786960838.519952:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.520159:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958341120 00000100:00100000:0.0:1786960838.520169:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958341120 00000100:00100000:0.0:1786960838.520249:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1786960838.520260:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958341120:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786960838.520505:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1786960838.520509:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1786960838 -> 1786960837 00002000:00010000:0.0:1786960838.520511:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786960835 00002000:00010000:0.0:1786960838.520514:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786960838 -> 1786960837 00002000:00010000:0.0:1786960838.520516:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786960838.520572:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958341120:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 314us (628us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1786960838.520589:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00010000:00010000:3.0:1786960838.523589:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523606:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523614:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523620:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960838.523625:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523633:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523651:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:3.0:1786960838.523654:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960838.523658:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.523680:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980154 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.523914:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.523985:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958341376 00000100:00100000:0.0:1786960838.523994:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958341376 00000100:00100000:0.0:1786960838.524055:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:0.0:1786960838.524066:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11516:x1873763958341376:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786960838.524129:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.524144:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.524152:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.524315:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.524331:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 18 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960838.524346:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967773312:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960838.524425:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e774f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960838.526903:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967773312:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960838.526930:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.528725:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.528927:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958341504 00000100:00100000:0.0:1786960838.528947:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958341504 00010000:00010000:0.0:1786960838.528981:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960838.529017:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1786960838.529026:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:2341:x1873763958341504:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960838.529039:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960838.529053:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529065:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529086:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c980123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c16d expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529100:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:0.0:1786960838.529105:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529114:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529121:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.529143:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960838.529215:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2341:x1873763958341504:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 190us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960838.529230:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00010000:00010000:3.0:1786960838.529497:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529506:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529535:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529542:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529549:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529556:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960838.529560:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529568:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529578:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:3.0:1786960838.529580:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1786960838.529584:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.529589:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98015b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960838.529663:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958341376:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 5598us (5752us total) trans 0 rc -22/-22 00000100:00100000:3.0:1786960838.529670:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 185 00000100:00100000:1.0:1786960838.532943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960838.533020:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958341632 00000100:00100000:2.0:1786960838.533030:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958341632 00000100:00100000:2.0:1786960838.533097:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1786960838.533107:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958341632:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786960838.533153:0:8239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.533173:0:8239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 8 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.533182:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960838.533236:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786960838.533242:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.533277:0:8239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 8 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.533291:0:8239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 8 pid: 8239 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960838.533319:0:8239:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8239:1873763967773440:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960838.533394:0:8239:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a81e480 going to sleep for 11 seconds 00000100:00100000:2.0:1786960838.538976:0:8239:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8239:1873763967773440:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960838.539004:0:8239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.540883:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.540971:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958341760 00000100:00100000:3.0:1786960838.540979:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958341760 00010000:00010000:3.0:1786960838.541010:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960838.541045:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:3.0:1786960838.541058:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2344:x1873763958341760:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960838.541071:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960838.541093:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.541106:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.541128:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ac39229/0x1808d16e4c98014d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c189 expref: 9 pid: 8239 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.541145:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960838.541149:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960838.541156:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.541177:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.541257:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960838.541308:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958341760:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 250us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.541315:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00010000:00010000:2.0:1786960838.541956:0:8239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.541966:0:8239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.541991:0:8239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.541999:0:8239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.542007:0:8239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.542014:0:8239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960838.542018:0:8239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.542040:0:8239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.542065:0:8239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.542074:0:8239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008db4c124/0x1808d16e4c980162 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960838.542136:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958341632:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 9029us (9201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.542144:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1786960838.546986:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.547085:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342016 00000100:00100000:0.0:1786960838.547095:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342016 00000100:00100000:0.0:1786960838.547151:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 186 00000100:00100000:0.0:1786960838.547162:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+17:11516:x1873763958342016:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786960838.547416:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547435:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547446:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547755:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547769:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547776:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547810:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960838.547834:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 18 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960838.547865:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967773568:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960838.548246:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ad0b300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960838.552681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.552752:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342144 00000100:00100000:3.0:1786960838.552760:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342144 00010000:00010000:3.0:1786960838.552798:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960838.552843:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:3.0:1786960838.552854:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:2343:x1873763958342144:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960838.552870:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960838.552877:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.552890:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 19 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.552911:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:3.0:1786960838.552917:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.552926:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.552947:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.552965:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960838.553024:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:2343:x1873763958342144:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.553032:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00010000:00010000:1.0:1786960838.553379:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c174 expref: 18 pid: 8734 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.553396:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967773568:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960838.553416:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.553425:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.553432:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786960838.553617:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1786960838.553762:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1786960838.553806:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1786960838.553894:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967773696:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786960838.553937:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960838.553970:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681687a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960838.554073:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967773696 00000100:00100000:2.0:1786960838.554080:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967773696 00000100:00100000:2.0:1786960838.554117:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960838.554125:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967773696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786960838.554221:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967773696:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.554228:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786960838.554442:0:5812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1786960838.554448:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff976650f00e00, transno 4294967315 00000100:00100000:1.0:1786960838.554637:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967773696:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1786960838.555415:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1786960838.555798:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967773824:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786960838.555856:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960838.555960:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766816870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786960838.557360:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967773824 00000100:00100000:2.0:1786960838.557370:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967773824 00000100:00100000:2.0:1786960838.557559:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786960838.557570:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967773824:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786960838.557955:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1873763967773824:12345-0@lo:1000:mdt00_002.0 Request processed in 387us (2098us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1786960838.557977:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786960838.558410:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967773824:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1786960838.558566:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558577:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558585:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558591:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.558596:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558604:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558684:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976661496e00) 00010000:00010000:1.0:1786960838.558687:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786960838.558692:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558699:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c980170 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558736:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558743:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558749:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558764:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.558767:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558773:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558782:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:1.0:1786960838.558784:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786960838.558787:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558793:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c9800a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558813:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558838:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558846:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558877:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.558891:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 21 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.558916:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967773952:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960838.559027:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766816870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960838.563904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.563993:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342272 00000100:00100000:3.0:1786960838.564002:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342272 00010000:00010000:3.0:1786960838.564039:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960838.564084:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:3.0:1786960838.564094:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2344:x1873763958342272:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960838.564109:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960838.564116:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.564129:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 22 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.564150:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:3.0:1786960838.564155:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.564165:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.564210:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.564228:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960838.564286:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2344:x1873763958342272:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 192us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.564293:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00010000:00010000:1.0:1786960838.565728:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9800c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c158 expref: 21 pid: 5812 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.565750:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967773952:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960838.565771:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565780:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565785:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565798:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565803:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565809:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565815:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.565828:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565835:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565859:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:1.0:1786960838.565862:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960838.565867:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565872:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93e00/0x1808d16e4c980177 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565882:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565888:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565894:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565898:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960838.565901:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565907:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565913:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496600) 00010000:00010000:1.0:1786960838.565916:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786960838.565918:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960838.565924:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980169 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960838.566376:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11516:x1873763958342016:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 19214us (19397us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1786960838.566386:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 186 00000020:00080000:1.0:1786960838.566390:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786960838.566560:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960838.566565:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960838.567105:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1786960838.567121:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786960838.575322:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960838.575414:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342528 00000100:00100000:3.0:1786960838.575424:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342528 00000100:00100000:3.0:1786960838.575622:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1786960838.575632:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11516:x1873763958342528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786960838.576673:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786960838.576776:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1786960838.576829:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576845:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576858:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576866:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576873:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576879:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960838.576950:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786960838.577059:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11516:x1873763958342528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1418us (1734us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1786960838.577068:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000020:00080000:3.0:1786960838.577073:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960838.579515:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960838.579527:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.579537:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960838.579541:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.579551:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.579567:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960838.579570:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786960838.579574:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.579580:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98017e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960838.579601:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960838.579603:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960838.579605:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960838.806549:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.806583:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960838.806624:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960838.806711:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342784 00000100:00100000:1.0:1786960838.806722:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342784 00000100:00100000:1.0:1786960838.806784:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:1.0:1786960838.806793:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958342784:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960838.806866:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2342:x1873763958342784:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960838.806874:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00080000:0.0:1786960838.806941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960838.807260:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342912 00000100:00100000:2.0:1786960838.807265:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342912 00000100:00100000:2.0:1786960838.807333:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00100000:2.0:1786960838.807340:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958342912:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960838.807395:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2342:x1873763958342912:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 55us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960838.807402:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 162 00000100:00080000:0.0:1786960838.807867:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960838.808476:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958342656 00000100:00100000:3.0:1786960838.808484:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958342656 00000100:00100000:3.0:1786960838.808571:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 298 00000100:00100000:3.0:1786960838.808580:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958342656:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960838.809018:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2342:x1873763958342656:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 438us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960838.809026:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 298 00010000:00010000:0.0:1786960838.900523:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960839.924335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786960840.258471:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960840.258482:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960840.258523:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1786960840.258530:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786960840.423119:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960840.423266:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958343168 00000100:00100000:1.0:1786960840.423280:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958343168 00000100:00100000:1.0:1786960840.423366:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00100000:1.0:1786960840.423379:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:11534:x1873763958343168:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960840.423413:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960840.423441:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c980185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c190 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.423783:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98018c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.423801:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98018c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.423826:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98018c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960840.423854:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1786960840.424048:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c980185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c190 expref: 25 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.424070:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98018c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c190 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.424080:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960840.424083:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786960840.424088:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93400, rc 0) 00000100:00100000:1.0:1786960840.424165:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:11534:x1873763958343168:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 789us (1060us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1786960840.424174:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 187 00000100:00080000:3.0:1786960840.424618:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960840.427137:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960840.427421:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958343296 00000100:00100000:1.0:1786960840.427434:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958343296 00000100:00100000:1.0:1786960840.427507:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:1.0:1786960840.427520:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:11534:x1873763958343296:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:1.0:1786960840.427617:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.427638:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.427651:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.427670:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.427694:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.427701:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428690:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428705:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428714:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786960840.428767:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428796:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428804:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428819:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428826:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960840.428830:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.428839:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430163:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:1.0:1786960840.430166:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960840.430173:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430181:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92e00/0x1808d16e4c98019a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430218:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430226:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430234:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430679:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960840.430684:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430692:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430702:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496600) 00010000:00010000:1.0:1786960840.430704:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960840.430707:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430713:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430746:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430752:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430757:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430763:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960840.430766:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430772:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430779:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff976661496e00) 00010000:00010000:1.0:1786960840.430964:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960840.430968:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.430975:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93a00/0x1808d16e4c9801a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960840.432091:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:11534:x1873763958343296:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 4562us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960840.432106:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 188 00000100:00100000:0.0:1786960840.504461:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960840.514113:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958343552 00000100:00100000:0.0:1786960840.514134:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958343552 00000100:00100000:0.0:1786960840.515518:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:0.0:1786960840.515538:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+24:11537:x1873763958343552:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960840.515566:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960840.515593:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9801af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c197 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515685:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515700:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515713:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515740:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515749:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.515755:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.516144:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.516154:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.516163:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960840.516175:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1786960840.516322:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.516331:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.516338:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528311:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960840.528332:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528388:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528412:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960840.528415:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960840.528422:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528429:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1800/0x1808d16e4c9801b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528455:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528462:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528470:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528476:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e1000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960840.528479:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528486:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528494:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559de300) 00010000:00010000:0.0:1786960840.528497:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960840.528499:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528515:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e1000/0x1808d16e4c9801bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528601:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0000/0x1808d16e4c9801af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528620:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.528629:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:0.0:1786960840.528632:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960840.528635:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927a00, rc 0) 00000100:00100000:0.0:1786960840.528757:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11537:x1873763958343552:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 13225us (24306us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1786960840.528767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 189 00000100:00100000:3.0:1786960840.547839:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960840.548020:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958343680 00000100:00100000:1.0:1786960840.548032:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958343680 00000100:00100000:1.0:1786960840.548098:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:1.0:1786960840.548118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11537:x1873763958343680:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1786960840.548225:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551399:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551431:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551475:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551484:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551492:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551500:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960840.551505:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551513:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551526:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:1.0:1786960840.551529:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786960840.551534:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.551540:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9801d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960840.551665:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11537:x1873763958343680:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 3542us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960840.551676:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 190 00000100:00100000:3.0:1786960840.553950:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.554002:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958343936 00000100:00100000:3.0:1786960840.554038:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958343936 00000100:00100000:3.0:1786960840.554100:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1786960840.554111:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11537:x1873763958343936:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1786960840.554411:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:11537:x1873763958343936:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 300us (474us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1786960840.554420:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:3.0:1786960840.612411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.612467:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344192 00000100:00100000:3.0:1786960840.612479:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344192 00000100:00100000:3.0:1786960840.612546:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:3.0:1786960840.612557:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:11064:x1873763958344192:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960840.612588:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960840.612613:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c9801d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c19e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.613237:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.613910:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.613921:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.613969:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.613986:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 28 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960840.614002:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967774080:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960840.614098:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960840.641295:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967774080:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960840.641323:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960840.641475:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.644074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344320 00000100:00100000:3.0:1786960840.644088:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344320 00010000:00010000:3.0:1786960840.644143:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 29 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960840.644177:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 74 00000100:00100000:3.0:1786960840.644209:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:2343:x1873763958344320:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960840.644224:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960840.644231:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 29 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644245:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 29 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644277:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927a00/0x1808d16e4c9801c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c197 expref: 29 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644292:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:3.0:1786960840.644297:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644305:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644312:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.644335:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960840.644397:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:2343:x1873763958344320:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 212us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960840.644405:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 74 00000001:00080000:3.0:1786960840.659559:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:3.0:1786960840.659589:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.659602:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960840.659625:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1786960840.659780:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045000/0x1808d16e4c9801d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.659802:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.659825:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:3.0:1786960840.660028:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786960840.660033:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:3.0:1786960840.660102:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:11064:x1873763958344192:12345-192.168.203.23@tcp:101:bash.0 Request processed in 47546us (47706us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1786960840.660111:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 191 00000100:00100000:0.0:1786960840.677617:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960840.677669:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344576 00000100:00100000:0.0:1786960840.677678:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344576 00000100:00100000:0.0:1786960840.677733:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 192 00000100:00100000:0.0:1786960840.677743:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:11064:x1873763958344576:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1786960840.678001:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.678018:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.678030:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960840.678086:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1786960840.678108:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007878255f reply state 0000000001bc19f1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960840.678118:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1786960840.678163:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1786960840.678286:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11064:x1873763958344576:12345-192.168.203.23@tcp:36:bash.0 Request processed in 543us (676us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1786960840.678295:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 192 00000020:00080000:0.0:1786960840.678299:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1786960840.696085:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960840.696106:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:1.0:1786960840.696115:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.696136:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.696144:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960840.696150:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.696160:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.696182:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:1.0:1786960840.696238:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960840.696244:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960840.696251:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c9801ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960840.696389:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344704 00000100:00100000:2.0:1786960840.696402:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344704 00000100:00100000:2.0:1786960840.696478:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:2.0:1786960840.696491:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:11064:x1873763958344704:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960840.696522:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960840.696544:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9801f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1a5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.696619:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9801f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1a5 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.696635:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9801f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1a5 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.696656:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:2.0:1786960840.696659:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960840.696661:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e600, rc 0) 00000100:00100000:2.0:1786960840.696733:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11064:x1873763958344704:12345-192.168.203.23@tcp:101:bash.0 Request processed in 245us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960840.696756:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 193 00000100:00100000:1.0:1786960840.710136:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.711677:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344832 00000100:00100000:3.0:1786960840.711692:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344832 00000100:00080000:0.0:1786960840.711770:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960840.711782:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1786960840.711797:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:11064:x1873763958344832:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960840.711826:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960840.711868:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1ac expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960840.711895:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a82dbc5, atime: 0x6a82dbc3, ctime: 0x6a82dbc5, blocks: 0xb 00010000:00010000:3.0:1786960840.711916:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1786960840.711921:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960840.711929:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.711947:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 8 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960840.711959:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:3.0:1786960840.712027:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:11064:x1873763958344832:12345-192.168.203.23@tcp:101:bash.0 Request processed in 235us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960840.712034:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:0.0:1786960840.718365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.719140:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958344960 00000100:00100000:3.0:1786960840.719156:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958344960 00002000:00010000:3.0:1786960840.719254:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1786960840.719260:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97664e74f100 with x1873763958344960 ext(0->18446744073709551615) 00002000:00010000:3.0:1786960840.719275:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97664e74f100. 00000100:00100000:3.0:1786960840.719313:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960840.719324:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958344960:12345-192.168.203.23@tcp:10:bash.0 00002000:00010000:3.0:1786960840.719675:0:6663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1786960840.719680:0:6663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1786960837 -> 1786960841 00002000:00010000:3.0:1786960840.719682:0:6663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1786960835 -> 1786960835 00002000:00010000:3.0:1786960840.719698:0:6663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1786960837 -> 1786960841 00002000:00010000:3.0:1786960840.719700:0:6663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1786960840.721012:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958344960:12345-192.168.203.23@tcp:10:bash.0 Request processed in 1678us (2651us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1786960840.721028:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00002000:00010000:3.0:1786960840.721044:0:6663:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1786960840.721049:0:6663:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97664e74f100 with x1873763958344960 ext(0->18446744073709551615) 00002000:00010000:3.0:1786960840.721058:0:6663:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97664e74f100. 00000100:00100000:0.0:1786960840.865439:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960840.866623:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958345088 00000100:00100000:2.0:1786960840.866640:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958345088 00000100:00100000:2.0:1786960840.866728:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:2.0:1786960840.866739:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11551:x1873763958345088:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:2.0:1786960840.866849:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.866870:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.866884:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.866902:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.866910:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.866917:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867533:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867546:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867554:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960840.867621:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867634:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867641:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867649:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867655:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960840.867660:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867668:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867681:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960840.867684:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960840.867690:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867696:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867710:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867716:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867727:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867732:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960840.867735:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867742:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867749:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976664f8c400) 00010000:00010000:2.0:1786960840.867752:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960840.867755:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867761:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98020a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867776:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867782:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867788:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867793:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960840.867795:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867820:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867829:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:2.0:1786960840.867832:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960840.867835:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.867840:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980211 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960840.868549:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11551:x1873763958345088:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 1802us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960840.868563:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 194 00000100:00100000:1.0:1786960840.924172:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960840.924478:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958345344 00000100:00100000:2.0:1786960840.924492:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958345344 00000100:00100000:2.0:1786960840.924563:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:2.0:1786960840.924576:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+32:11555:x1873763958345344:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960840.924605:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960840.924633:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1b3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924727:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924744:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924758:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924783:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924791:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.924798:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925523:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98022d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925538:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98022d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925547:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98022d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960840.925559:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1786960840.925675:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925683:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925690:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925697:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960840.925701:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925721:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925735:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960840.925739:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960840.925745:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925752:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98021f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925766:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925773:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925779:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925784:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960840.925787:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925793:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925800:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976664f8c400) 00010000:00010000:2.0:1786960840.925810:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960840.925814:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.925831:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.926952:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1b3 expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.926971:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98022d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1b3 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.926980:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:2.0:1786960840.926983:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786960840.926986:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960840.927070:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11555:x1873763958345344:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 2495us (2911us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1786960840.927078:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 195 00000100:00100000:0.0:1786960840.933988:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960840.934078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958345472 00000100:00100000:2.0:1786960840.934091:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958345472 00000100:00100000:2.0:1786960840.934170:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:2.0:1786960840.934182:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11555:x1873763958345472:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:2.0:1786960840.934312:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.934334:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.934344:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.934407:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.934422:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 34 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960840.934439:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967774208:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960840.934571:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766466ce000 going to sleep for 11 seconds 00000100:00100000:0.0:1786960840.936684:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960840.936755:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958345728 00000100:00100000:3.0:1786960840.936766:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958345728 00000100:00100000:3.0:1786960840.936844:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1786960840.936855:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:5581:x1873763958345728:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786960840.937296:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:5581:x1873763958345728:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 442us (622us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1786960840.937304:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1786960840.940651:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681636300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967774208:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960840.940694:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960840.942977:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960840.943043:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958345856 00000100:00100000:2.0:1786960840.943056:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958345856 00010000:00010000:2.0:1786960840.943110:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 36 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960840.943687:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 75 00000100:00100000:2.0:1786960840.943700:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:2344:x1873763958345856:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960840.943719:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960840.943727:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 36 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943742:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 36 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943794:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9801e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c19e expref: 36 pid: 5810 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943823:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:2.0:1786960840.943829:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943847:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943855:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960840.943892:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960840.943970:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d14850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:2344:x1873763958345856:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 272us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960840.943979:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 75 00010000:00010000:0.0:1786960840.947919:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.947941:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.947991:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.947999:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.948007:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.948041:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ea00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960840.948047:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.948054:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.948076:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:0.0:1786960840.948079:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960840.948084:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960840.948090:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c98023b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960840.948264:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11555:x1873763958345472:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 14077us (14281us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960840.948275:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 196 00000100:00100000:3.0:1786960840.952076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960840.952386:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958346112 00000100:00100000:0.0:1786960840.952400:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958346112 00000100:00100000:0.0:1786960840.952472:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1786960840.952485:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+34:11555:x1873763958346112:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1786960840.952773:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11555:x1873763958346112:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 289us (709us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1786960840.952781:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00010000:00010000:0.0:1786960840.955560:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960841.064728:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960841.066049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958346368 00000100:00100000:1.0:1786960841.066068:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958346368 00000100:00100000:1.0:1786960841.066159:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:1.0:1786960841.066171:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+35:11566:x1873763958346368:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:1.0:1786960841.066375:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960841.066405:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980242 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1ba expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066500:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066517:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066533:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066550:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066558:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.066565:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.070967:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.070998:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071014:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960841.071092:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1786960841.071442:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071467:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071474:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071482:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960841.071487:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071494:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071509:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:3.0:1786960841.071512:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960841.071517:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071523:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071542:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071548:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071555:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071560:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960841.071571:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071578:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071586:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496e00) 00010000:00010000:3.0:1786960841.071589:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960841.071592:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071598:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071665:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980242 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ba expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071681:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ba expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.071689:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:3.0:1786960841.071692:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960841.071695:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:3.0:1786960841.071821:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:11566:x1873763958346368:12345-192.168.203.23@tcp:101:cat.0 Request processed in 5651us (7104us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1786960841.071831:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 197 00000100:00100000:0.0:1786960841.077708:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.077994:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958346624 00000100:00100000:3.0:1786960841.078006:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958346624 00000100:00100000:3.0:1786960841.078681:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1786960841.078693:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:11566:x1873763958346624:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:3.0:1786960841.079482:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11566:x1873763958346624:12345-192.168.203.23@tcp:35:cat.0 Request processed in 788us (1784us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1786960841.079493:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:1.0:1786960841.094638:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.098106:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958346880 00000100:00100000:0.0:1786960841.098127:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958346880 00000100:00100000:0.0:1786960841.098540:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 198 00000100:00100000:0.0:1786960841.098556:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11567:x1873763958346880:12345-192.168.203.23@tcp:36:rm.0 00010000:00010000:0.0:1786960841.098639:0:8734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786960841.098675:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ba expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098705:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98022d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1b3 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098721:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9801f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1a5 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098733:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559def00) 00010000:00010000:0.0:1786960841.098745:0:8734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960841.098783:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098800:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098820:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098835:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098842:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.098884:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.099596:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.099608:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.099617:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960841.103896:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1786960841.103926:0:8734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323130738877ns, next at 324130732784ns, rc = 0 00010000:00010000:0.0:1786960841.106091:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.106127:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.106145:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.106157:0:8734:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.106164:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.106171:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107329:0:8734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960841.107370:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107379:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107386:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107393:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.107398:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107406:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107422:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559de500) 00010000:00010000:0.0:1786960841.107426:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786960841.107432:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107438:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926400/0x1808d16e4c980273 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107467:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107474:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107480:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107494:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.107497:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107503:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107512:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960841.107514:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.107518:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.107523:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927800/0x1808d16e4c980265 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960841.107535:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000834c3462 reply state 000000000c59bda8 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.107546:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960841.107664:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+37:11567:x1873763958346880:12345-192.168.203.23@tcp:36:rm.0 Request processed in 9106us (13033us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1786960841.107674:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 198 00010000:00010000:3.0:1786960841.112937:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960841.112956:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.112969:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960841.112973:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.112984:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.113006:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9766559de500) 00010000:00010000:3.0:1786960841.113009:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786960841.113014:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.113020:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c98027a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.113055:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960841.113057:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960841.113059:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960841.113585:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113596:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113603:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113608:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960841.113613:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113641:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113652:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559de300) 00010000:00010000:2.0:1786960841.113654:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960841.113658:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.113664:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927600/0x1808d16e4c98026c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960841.162614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.164992:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347136 00000100:00100000:2.0:1786960841.165012:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347136 00000100:00100000:2.0:1786960841.165109:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 199 00000100:00100000:2.0:1786960841.165120:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+36:11573:x1873763958347136:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960841.165149:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960841.165174:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980281 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1c1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165392:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165410:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165695:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165716:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165738:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.165745:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786960841.166707:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1786960841.167790:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.167820:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.167833:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.167878:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.167887:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.167894:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.169633:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960841.169649:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.169664:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.169711:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960841.169715:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960841.169721:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.169729:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c980288 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960841.169754:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d7a34a0 reply state 00000000f6535d6f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.169766:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786960841.169838:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c980281 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.169856:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.171320:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:2.0:1786960841.171346:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960841.171353:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ec00, rc 0) 00000100:00100000:2.0:1786960841.171536:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766743aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:11573:x1873763958347136:12345-192.168.203.23@tcp:101:bash.0 Request processed in 6412us (8931us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1786960841.171548:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 199 00010000:00010000:1.0:1786960841.177788:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.177818:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.177844:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.177852:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960841.177857:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.177876:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.177898:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976664f8c400) 00010000:00010000:1.0:1786960841.177998:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960841.178005:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.178012:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98028f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.186653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.189543:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347264 00000100:00100000:0.0:1786960841.189564:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347264 00000100:00100000:0.0:1786960841.189678:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1786960841.189695:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2341:x1873763958347264:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:0.0:1786960841.189720:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960841.189750:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1c8 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786960841.189784:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1786960841.189819:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786960841.189850:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1786960841.189856:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960841.189867:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.189891:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.189920:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926400, rc 0) 00000100:00100000:0.0:1786960841.190009:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2341:x1873763958347264:12345-192.168.203.23@tcp:101:bash.0 Request processed in 319us (3371us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.190017:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:0.0:1786960841.202745:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.203621:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347392 00000100:00100000:3.0:1786960841.203638:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347392 00000100:00100000:3.0:1786960841.203719:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1786960841.203730:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:11573:x1873763958347392:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960841.203774:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960841.203798:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1cf expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.203848:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.203859:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960841.203874:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960841.203880:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.203934:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.203951:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.203967:0:6658:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967774336:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960841.204097:0:6658:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efc300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960841.206964:0:6658:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6658:1873763967774336:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960841.207013:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.207057:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045a00, rc 0) 00000100:00100000:3.0:1786960841.207150:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:11573:x1873763958347392:12345-192.168.203.23@tcp:101:bash.0 Request processed in 3420us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960841.207162:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1786960841.211075:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.211266:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347520 00000100:00100000:3.0:1786960841.211280:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347520 00010000:00010000:3.0:1786960841.211332:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.211380:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:3.0:1786960841.211391:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958347520:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960841.211410:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960841.211437:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.211452:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.211479:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052baba16/0x1808d16e4c9802a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c8 expref: 7 pid: 6659 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.211500:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960841.211505:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960841.211516:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.211527:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.211765:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.211793:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967774464:192.168.203.23@tcp:105: 00000100:00100000:3.0:1786960841.211908:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efc300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960841.218373:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960841.218595:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347776 00000100:00100000:1.0:1786960841.218605:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347776 00000100:00100000:3.0:1786960841.218626:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976677b69f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1873763967774464:192.168.203.23@tcp:105: 00010000:00010000:3.0:1786960841.218656:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960841.218678:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960841.218688:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+38:11573:x1873763958347776:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1786960841.218716:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2343:x1873763958347520:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 7327us (7657us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960841.218725:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:1.0:1786960841.219097:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:11573:x1873763958347776:12345-192.168.203.23@tcp:35:bash.0 Request processed in 409us (737us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1786960841.219104:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:1.0:1786960841.439434:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.439575:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958347904 00000100:00100000:2.0:1786960841.439588:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958347904 00000100:00100000:2.0:1786960841.439697:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:2.0:1786960841.439709:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+39:11589:x1873763958347904:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960841.439748:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960841.439774:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1d6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.439891:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.439916:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.439931:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960841.440018:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1786960841.440022:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960841.440058:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.440089:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1d6 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.440110:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1d6 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.440120:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:2.0:1786960841.440124:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786960841.440128:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f000, rc 0) 00000100:00100000:2.0:1786960841.440312:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+40:11589:x1873763958347904:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 603us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.440320:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 200 00000100:00100000:0.0:1786960841.448436:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.448648:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348160 00000100:00100000:3.0:1786960841.448660:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348160 00000100:00100000:3.0:1786960841.448737:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:3.0:1786960841.448747:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+40:11589:x1873763958348160:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960841.448774:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960841.448809:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c9802c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1dd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.448938:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9802c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.448953:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9802c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.448967:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9802c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960841.449001:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786960841.449793:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c9802c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1dd expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.449828:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9802c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1dd expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.449838:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:3.0:1786960841.449841:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960841.449846:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:3.0:1786960841.449992:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+42:11589:x1873763958348160:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1244us (1577us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1786960841.450002:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 201 00000100:00100000:0.0:1786960841.466103:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.466259:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348416 00000100:00100000:2.0:1786960841.466272:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348416 00000100:00100000:2.0:1786960841.466350:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:2.0:1786960841.466362:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+42:11589:x1873763958348416:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960841.466395:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960841.466433:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1e4 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.466704:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.466722:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.466736:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960841.466751:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1786960841.467041:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1e4 expref: 45 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.467062:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1e4 expref: 44 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.467071:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:2.0:1786960841.467075:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786960841.467078:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e000, rc 0) 00000100:00100000:2.0:1786960841.467368:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:11589:x1873763958348416:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1006us (1276us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1786960841.467394:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 202 00000100:00100000:0.0:1786960841.473459:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.479021:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348544 00000100:00100000:2.0:1786960841.479229:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348544 00000100:00100000:2.0:1786960841.479694:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1786960841.479709:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+44:2342:x1873763958348544:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960841.479731:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960841.479763:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c9802c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1dd expref: 44 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.479806:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:2.0:1786960841.479812:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960841.479897:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+43:2342:x1873763958348544:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 192us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.479906:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1786960841.489798:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960841.492763:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348672 00000100:00100000:1.0:1786960841.492795:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348672 00000100:00100000:1.0:1786960841.492917:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1786960841.492930:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+6:2344:x1873763958348672:12345-192.168.203.23@tcp:1:lfs.0 00010000:00010000:1.0:1786960841.492991:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.493016:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.493026:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960841.493031:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960841.493036:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.493084:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960841.493101:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 6 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960841.493119:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674115f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967774592:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960841.493284:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681687000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960841.500066:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674115f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6659:1873763967774592:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960841.500113:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.504426:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.504585:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348800 00000100:00100000:3.0:1786960841.504599:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348800 00002000:00100000:3.0:1786960841.504663:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff976681707100 x1873763958348800/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:427/0 lens 504/0 e 0 to 0 dl 1786960852 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960841.504676:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff976681707100 with x1873763958348800 ext(0->8) 00010000:00010000:3.0:1786960841.504686:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 7 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.504705:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 7 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960841.504713:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff976681707100 00000100:00100000:3.0:1786960841.504753:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1786960841.504782:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958348800:12345-192.168.203.23@tcp:4:lfs.0 00000100:00100000:3.0:1786960841.505842:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958348800:12345-192.168.203.23@tcp:4:lfs.0 Request processed in 1056us (1431us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1786960841.505854:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00002000:00100000:3.0:1786960841.505864:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff976681707100 x1873763958348800/t4294967308(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:427/0 lens 504/448 e 0 to 0 dl 1786960852 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960841.505874:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff976681707100 with x1873763958348800 ext(0->8) 00010000:00010000:3.0:1786960841.505883:0:6664:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.505899:0:6664:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960841.505908:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff976681707100 00000100:00100000:1.0:1786960841.518033:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.519006:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958348928 00000100:00100000:0.0:1786960841.519022:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958348928 00010000:00010000:0.0:1786960841.519083:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.519164:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:0.0:1786960841.519177:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958348928:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960841.519241:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1786960841.519266:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1786960841.519270:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786960841 00002000:00010000:0.0:1786960841.519272:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786960842 00002000:00010000:0.0:1786960841.519274:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786960841 00010000:00010000:0.0:1786960841.519282:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.519298:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.519329:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e7935eb/0x1808d16e4c9802ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1cf expref: 9 pid: 6658 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.519351:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960841.519358:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960841.519366:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.519377:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.519418:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960841.519512:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958348928:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 337us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.519521:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00010000:00010000:2.0:1786960841.520305:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520321:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520357:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520380:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520399:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520407:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960841.520413:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520433:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520451:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.520459:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c9802ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.520552:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958348672:12345-192.168.203.23@tcp:1:lfs.0 Request processed in 27622us (30772us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.520562:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:2.0:1786960841.528287:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967774720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960841.528382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960841.528494:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967774720 00000100:00100000:2.0:1786960841.528504:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967774720 00000100:00100000:2.0:1786960841.528577:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1786960841.528586:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960841.528589:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967774720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960841.528634:0:6661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960841.528695:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1873763967774720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.528703:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786960841.528762:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967774720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960841.528850:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967774976:0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.528885:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960841.528922:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786960841.528928:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967774848:0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.528956:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960841.528980:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967775360:0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.529005:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960841.529008:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967774848 00000100:00100000:0.0:1786960841.529012:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967774848 00000100:00100000:1.0:1786960841.529042:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967775104:0@lo:400:kworker.0 00000100:00100000:0.0:1786960841.529043:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1786960841.529050:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967774848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.529065:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960841.529089:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967774848:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.529100:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1786960841.529132:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967775104 00000100:00100000:0.0:1786960841.529132:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967774976 00000100:00100000:2.0:1786960841.529135:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967775104 00000100:00100000:0.0:1786960841.529135:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967774976 00000100:00100000:2.0:1786960841.529167:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1786960841.529174:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967775104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960841.529174:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786960841.529179:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967774976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.532264:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960841.532924:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967775232:0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.533018:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960841.533972:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967775360 00000100:00100000:1.0:1786960841.533985:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967775360 00000100:00100000:1.0:1786960841.535380:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786960841.535730:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967774976:12345-0@lo:400:kworker.0 Request processed in 6546us (6840us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.535744:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1786960841.535772:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967775232 00000100:00100000:0.0:1786960841.535781:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967775232 00000100:00100000:0.0:1786960841.535837:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786960841.535847:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967775232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960841.535922:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967775232:12345-0@lo:400:kworker.0 Request processed in 76us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.535930:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786960841.535990:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967775232:0@lo:400:kworker.0 00000100:00100000:0.0:1786960841.536285:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967774848:0@lo:400:kworker.0 00000100:00100000:0.0:1786960841.536327:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967774976:0@lo:400:kworker.0 00000100:00100000:1.0:1786960841.536561:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967775360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960841.536572:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967775104:12345-0@lo:400:kworker.0 Request processed in 7398us (7505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.536581:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1786960841.536610:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967775360:12345-0@lo:400:kworker.0 Request processed in 57us (7604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960841.536617:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1786960841.536641:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786960841.536643:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967775104:0@lo:400:kworker.0 00000100:00080000:1.0:1786960841.536647:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960841.536662:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1786960841.536669:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766770fc700, transno 4294967307 00000100:00100000:1.0:1786960841.536688:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967775360:0@lo:400:kworker.0 00000100:00100000:3.0:1786960841.537981:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.538282:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958349184 00000100:00100000:2.0:1786960841.538294:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958349184 00000100:00100000:2.0:1786960841.538347:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:2.0:1786960841.538358:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+43:11589:x1873763958349184:12345-192.168.203.23@tcp:35:lfs.0 00000004:00010000:2.0:1786960841.538491:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1e4 expref: 43 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960841.538780:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1786960841.538902:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1786960841.539544:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1786960841.539610:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.539630:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 47 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.539656:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.539700:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 47 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.539717:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 47 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.539736:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967775488:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960841.540331:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960841.548928:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1873763967775488:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960841.548971:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.561280:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.561969:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958349312 00000100:00100000:2.0:1786960841.561983:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958349312 00010000:00010000:2.0:1786960841.562042:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.562104:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1786960841.562115:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+48:2343:x1873763958349312:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960841.562134:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960841.562141:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562157:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562184:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c980296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1c1 expref: 48 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562257:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:2.0:1786960841.562263:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562272:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562280:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.562320:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960841.562395:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+47:2343:x1873763958349312:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 281us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.562404:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00010000:00010000:3.0:1786960841.566731:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.566756:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960841.566942:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1786960841.567231:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1786960841.567524:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967775616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960841.567614:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960841.567658:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766466ced80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960841.573547:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967775616 00000100:00100000:3.0:1786960841.573570:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967775616 00000100:00100000:2.0:1786960841.573720:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786960841.573733:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967775616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960841.575219:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967775616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1448us (7564us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.575235:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960841.580903:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967775616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1786960841.582054:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1786960841.582167:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967775744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786960841.582302:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960841.582350:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960841.582543:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967775744 00000100:00100000:1.0:1786960841.582559:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967775744 00000100:00100000:1.0:1786960841.582630:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786960841.582642:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1873763967775744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786960841.582897:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1873763967775744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 258us (595us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1786960841.582906:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786960841.583379:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1873763967775744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1786960841.583482:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1786960841.583538:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583551:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583560:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583567:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960841.583572:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583579:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583598:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:3.0:1786960841.583601:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1786960841.583607:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.583613:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f600/0x1808d16e4c9802f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786960841.583853:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1786960841.583963:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1786960841.583976:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323610788615ns, next at 324610785902ns, rc = 0 00000001:00080000:3.0:1786960841.583983:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1786960841.584039:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff976664f8c800) 00010000:00010000:3.0:1786960841.584043:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1786960841.584052:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9802dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1e4 expref: 51 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.584491:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:11589:x1873763958349184:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 46134us (46515us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1786960841.584502:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000020:00080000:3.0:1786960841.584507:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1786960841.592401:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.592578:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958349440 00000100:00100000:0.0:1786960841.592591:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958349440 00000100:00100000:0.0:1786960841.592671:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1786960841.592684:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+50:11589:x1873763958349440:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960841.592722:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960841.592750:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9802f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1eb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.593005:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9802f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1eb expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.593025:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9802f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1eb expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.593060:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960841.593063:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960841.593068:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926c00, rc 0) 00000100:00100000:0.0:1786960841.593135:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:11589:x1873763958349440:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 454us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.593143:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 203 00000100:00100000:0.0:1786960841.603154:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.603393:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958349696 00000100:00100000:3.0:1786960841.603407:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958349696 00000100:00100000:3.0:1786960841.603495:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1786960841.603507:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+51:11589:x1873763958349696:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1786960841.603851:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11589:x1873763958349696:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 346us (710us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1786960841.603860:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:1.0:1786960841.736384:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.736599:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958349824 00000100:00100000:0.0:1786960841.736612:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958349824 00000100:00100000:0.0:1786960841.736689:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:0.0:1786960841.736717:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11599:x1873763958349824:12345-192.168.203.23@tcp:34:lfs.0 00010000:00010000:0.0:1786960841.736827:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.736848:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.736861:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.736878:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.736884:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.736890:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.737011:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.737019:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738432:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960841.738616:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738635:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738659:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738666:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738674:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.738679:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738687:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738704:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960841.738707:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.738712:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738719:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9802ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738737:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738743:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738749:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738753:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.738762:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738768:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738777:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559de000) 00010000:00010000:0.0:1786960841.738779:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.738782:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738806:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c980306 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738824:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738830:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738835:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738841:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.738844:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738849:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738857:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960841.738859:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.738868:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.738875:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c98030d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.739002:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11599:x1873763958349824:12345-192.168.203.23@tcp:34:lfs.0 Request processed in 2282us (2627us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.739014:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 204 00000100:00100000:1.0:1786960841.830715:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.830920:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958350080 00000100:00100000:0.0:1786960841.830932:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958350080 00000100:00100000:0.0:1786960841.831115:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:0.0:1786960841.831128:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+52:11602:x1873763958350080:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960841.831155:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960841.831182:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980314 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1f2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831326:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831344:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831358:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831376:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831383:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831410:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831576:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831585:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831593:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960841.831603:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1786960841.831772:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831780:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831792:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831807:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.831812:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831820:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831833:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960841.831836:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.831849:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831855:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c98031b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831870:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831875:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831880:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831884:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.831887:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831893:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831900:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9766559de000) 00010000:00010000:0.0:1786960841.831902:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960841.831904:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831910:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c980322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831954:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831982:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 54 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.831990:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960841.831993:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960841.831995:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926800, rc 0) 00000100:00100000:0.0:1786960841.832360:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11602:x1873763958350080:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1233us (1657us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1786960841.832368:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 205 00000100:00100000:1.0:1786960841.835512:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.835850:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958350208 00000100:00100000:2.0:1786960841.835862:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958350208 00000100:00100000:0.0:1786960841.836722:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:0.0:1786960841.836740:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11602:x1873763958350208:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:0.0:1786960841.837752:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837775:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837839:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837875:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837883:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837891:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837915:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960841.837920:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837929:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837944:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960841.837947:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960841.837953:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.837958:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c980337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.838173:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11602:x1873763958350208:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 1436us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960841.838201:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 206 00000100:00100000:1.0:1786960841.840288:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.840447:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958350464 00000100:00100000:3.0:1786960841.840460:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958350464 00000100:00100000:3.0:1786960841.840537:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1786960841.840548:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+54:11602:x1873763958350464:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1786960841.840841:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:11602:x1873763958350464:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 294us (563us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1786960841.840850:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1786960841.939722:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.939824:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958350720 00000100:00100000:3.0:1786960841.939838:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958350720 00000100:00100000:3.0:1786960841.939915:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:3.0:1786960841.939944:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:11612:x1873763958350720:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960841.939975:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960841.939979:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786960841.942227:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f000/0x1808d16e4c9802b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1d6 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.942260:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:3.0:1786960841.942266:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960841.942293:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c98033e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c1f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.942441:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.942457:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.942467:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.943368:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.943387:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 55 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.943403:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967775872:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960841.943923:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960841.952444:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4bb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967775872:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960841.952493:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960841.953229:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.953823:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958350848 00000100:00100000:3.0:1786960841.953833:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958350848 00010000:00010000:3.0:1786960841.953888:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 56 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.953938:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:3.0:1786960841.953951:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+56:2343:x1873763958350848:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960841.953974:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960841.953990:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 56 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954006:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 56 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954043:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980329 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f2 expref: 56 pid: 5812 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954063:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960841.954070:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954080:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954088:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.954236:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960841.954309:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:2343:x1873763958350848:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 360us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960841.954318:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00010000:00010000:2.0:1786960841.960203:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.960228:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960841.960261:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1786960841.960520:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c98033e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.960547:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.960559:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960841.960562:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786960841.960567:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045a00, rc 0) 00000100:00100000:2.0:1786960841.960669:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:11612:x1873763958350720:12345-192.168.203.23@tcp:101:bash.0 Request processed in 20726us (20959us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1786960841.960679:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 207 00000100:00100000:1.0:1786960841.963017:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960841.963233:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351104 00000100:00100000:0.0:1786960841.963246:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351104 00000100:00100000:0.0:1786960841.963312:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 208 00000100:00100000:0.0:1786960841.963325:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+55:11612:x1873763958351104:12345-192.168.203.23@tcp:36:bash.0 00010000:00010000:0.0:1786960841.963699:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.963720:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960841.963733:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960841.963824:0:8734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1786960841.963852:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000521e0a8f reply state 0000000018fc8f24 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960841.963863:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960841.963992:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11612:x1873763958351104:12345-192.168.203.23@tcp:36:bash.0 Request processed in 660us (980us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1786960841.964001:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 208 00000020:00080000:0.0:1786960841.964006:0:8734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960841.967351:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967372:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967381:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967388:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960841.967410:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967419:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967440:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960841.967443:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960841.967448:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.967455:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927400/0x1808d16e4c980353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960841.971892:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960841.972161:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351232 00000100:00100000:2.0:1786960841.972174:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351232 00000100:00100000:2.0:1786960841.972275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:2.0:1786960841.972285:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11612:x1873763958351232:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960841.972315:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960841.972340:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c98035a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c200 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.972673:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.972692:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.972702:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.972751:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.972766:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 58 pid: 5810 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.972781:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967776000:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960841.972935:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96e40 going to sleep for 11 seconds 00010000:00010000:0.0:1786960841.973481:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960841.980984:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.981083:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351360 00000100:00100000:3.0:1786960841.981095:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351360 00010000:00010000:3.0:1786960841.981145:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 59 pid: 5810 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960841.981229:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:3.0:1786960841.981240:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:2343:x1873763958351360:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960841.981258:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960841.981266:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 59 pid: 5810 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.981281:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 59 pid: 5810 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.981312:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960841.981318:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.981329:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.981337:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960841.981381:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960841.981459:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:2343:x1873763958351360:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 219us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960841.981467:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00010000:00010000:2.0:1786960841.981754:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c980345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1f9 expref: 58 pid: 5810 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960841.981775:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766813e5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1873763967776000:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960841.981808:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.981819:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.981825:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960841.981877:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786960841.981882:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960841.981903:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.981936:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c98035a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.981965:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960841.981972:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960841.981976:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960841.981978:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e800, rc 0) 00000100:00100000:2.0:1786960841.982017:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11612:x1873763958351232:12345-192.168.203.23@tcp:101:bash.0 Request processed in 9734us (10142us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960841.982024:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 209 00000100:00100000:1.0:1786960841.987741:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960841.987847:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351616 00000100:00100000:3.0:1786960841.987861:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351616 00000100:00100000:3.0:1786960841.987973:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:3.0:1786960841.987986:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+57:11612:x1873763958351616:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:3.0:1786960841.988336:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11612:x1873763958351616:12345-192.168.203.23@tcp:35:bash.0 Request processed in 351us (610us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1786960841.988345:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1786960842.036951:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786960842.036984:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967776128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960842.037082:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960842.037214:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967776128 00000100:00100000:3.0:1786960842.037225:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967776128 00000100:00100000:3.0:1786960842.037292:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786960842.037304:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967776128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786960842.037336:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960842.037400:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967776128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.037417:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786960842.037550:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976681704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967776128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960842.078780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.079069:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351744 00000100:00100000:0.0:1786960842.079082:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351744 00000100:00100000:0.0:1786960842.079240:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00100000:0.0:1786960842.079251:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+58:11618:x1873763958351744:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1786960842.079281:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960842.079306:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980368 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c207 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079384:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079399:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079423:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960842.079516:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786960842.079520:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960842.079542:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079570:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980368 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c207 expref: 60 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079589:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c207 expref: 59 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.079599:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960842.079602:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960842.079606:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927000, rc 0) 00000100:00100000:0.0:1786960842.079685:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958351744:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 436us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960842.079693:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 210 00000100:00080000:1.0:1786960842.080271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960842.083698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.084019:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958351872 00000100:00100000:3.0:1786960842.084042:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958351872 00000100:00100000:3.0:1786960842.084120:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:3.0:1786960842.084132:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958351872:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960842.084160:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960842.084254:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c980376 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c20e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084342:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084360:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084373:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084390:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084397:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084403:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084534:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084549:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084555:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960842.084605:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1786960842.084623:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960842.084649:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084671:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084681:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084688:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084696:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084703:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960842.084708:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084717:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084731:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:3.0:1786960842.084735:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960842.084740:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084747:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98037d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084766:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.084773:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085309:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085317:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960842.085320:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085327:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085337:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976643e01500) 00010000:00010000:3.0:1786960842.085340:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960842.085342:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085347:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085394:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c980376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085424:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 60 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.085432:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960842.085434:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960842.085436:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:3.0:1786960842.085562:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11618:x1873763958351872:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1430us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.085582:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 211 00000100:00100000:3.0:1786960842.089846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.089902:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.089989:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352256 00000100:00100000:1.0:1786960842.090002:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352256 00000100:00100000:1.0:1786960842.090087:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:1.0:1786960842.090100:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11618:x1873763958352256:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960842.090127:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960842.090155:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980392 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c215 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090313:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090349:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090357:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090366:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090407:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090433:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.090448:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967776256:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960842.090569:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.090578:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.090588:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674115f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967776384:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960842.090613:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681687c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960842.091257:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352000 00000100:00100000:0.0:1786960842.091265:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352000 00010000:00010000:0.0:1786960842.091300:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 62 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960842.091332:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:0.0:1786960842.091341:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:2343:x1873763958352000:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960842.091354:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960842.091361:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 62 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.091386:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 62 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.091411:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960842.091427:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.091436:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.091443:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960842.091491:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:2343:x1873763958352000:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 150us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960842.091499:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00010000:00010000:1.0:1786960842.095470:0:8734:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.23@tcp) returned -22 from blocking AST (req@0000000023e578aa x1873763967776256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.095525:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c98038b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c20e expref: 61 pid: 5810 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.095561:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967776256:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960842.095579:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674115f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967776384:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960842.095863:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:1.0:1786960842.095871:0:8734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.095882:0:8734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.095892:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.096790:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.096932:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352384 00000100:00100000:2.0:1786960842.096945:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352384 00010000:00010000:2.0:1786960842.096998:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960842.097048:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:2.0:1786960842.097061:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:2344:x1873763958352384:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960842.097081:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960842.097088:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097101:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097143:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c200 expref: 61 pid: 5811 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097159:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960842.097164:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097176:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097227:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.097255:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960842.097320:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:2344:x1873763958352384:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 261us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.097327:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00010000:00010000:0.0:1786960842.098115:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.098128:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960842.098152:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1786960842.098383:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 61 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.098402:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 60 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.098423:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960842.098436:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960842.098440:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92800, rc 0) 00000100:00100000:0.0:1786960842.098486:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11618:x1873763958352256:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 8388us (8582us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1786960842.098495:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 212 00000100:00100000:0.0:1786960842.104437:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.104659:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352640 00000100:00100000:3.0:1786960842.104672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352640 00000100:00100000:3.0:1786960842.104754:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960842.104767:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11618:x1873763958352640:12345-192.168.203.23@tcp:103:lfs.0 00010000:00010000:3.0:1786960842.104803:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960842.104836:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9802f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1eb expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.104862:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960842.104868:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960842.104944:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958352640:12345-192.168.203.23@tcp:103:lfs.0 Request processed in 180us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.104954:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960842.107273:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.107506:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352768 00000100:00100000:2.0:1786960842.107518:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352768 00000100:00100000:2.0:1786960842.107589:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:2.0:1786960842.107601:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958352768:12345-192.168.203.23@tcp:58:lfs.0 00010000:00010000:2.0:1786960842.107738:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.107759:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.107772:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786960842.108052:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1786960842.108172:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958352768:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 572us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.108182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 213 00000100:00100000:0.0:1786960842.112086:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.112235:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958352896 00000100:00100000:2.0:1786960842.112248:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958352896 00000100:00100000:2.0:1786960842.112317:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 214 00000100:00100000:2.0:1786960842.112890:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+59:11618:x1873763958352896:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960842.112919:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960842.112948:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c21c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113022:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113035:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113059:0:5812:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113073:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113089:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960842.113092:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960842.113096:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 60 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.113124:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e800, rc 0) 00000100:00100000:2.0:1786960842.113373:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11618:x1873763958352896:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1046us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.113381:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 214 00000040:00080000:2.0:1786960842.678132:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960842.678146:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960842.678231:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1786960842.678240:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786960842.678412:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967776512:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786960842.678546:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96900 going to sleep for 11 seconds 00000100:00100000:0.0:1786960842.682136:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.682230:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958353024 00000100:00100000:3.0:1786960842.682243:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958353024 00000100:00100000:3.0:1786960842.682320:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:3.0:1786960842.682331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353024:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786960842.682373:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786960842.683032:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353024:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 699us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.683043:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 215 00000100:00100000:2.0:1786960842.683270:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967776512:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786960842.688920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.689078:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958353152 00000100:00100000:1.0:1786960842.689098:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958353152 00000100:00100000:1.0:1786960842.689177:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:1.0:1786960842.689222:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11619:x1873763958353152:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1786960842.689329:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689351:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689365:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689411:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689419:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689427:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689456:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689472:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689480:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960842.689529:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1786960842.689534:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960842.689548:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689561:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689567:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689575:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689591:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960842.689596:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689604:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689618:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:1.0:1786960842.689622:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960842.689627:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689633:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c9803b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689649:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689654:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689660:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689666:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960842.689668:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689675:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689692:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff976661496600) 00010000:00010000:1.0:1786960842.689694:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960842.689697:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689702:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c9803bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689717:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689723:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689728:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689733:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960842.689736:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689742:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689750:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:1.0:1786960842.689752:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960842.689755:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.689761:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c9803c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.691957:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11619:x1873763958353152:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 2757us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960842.691972:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 216 00000100:00100000:3.0:1786960842.694567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.694784:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958353408 00000100:00100000:0.0:1786960842.694808:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958353408 00000100:00100000:0.0:1786960842.694880:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:0.0:1786960842.694892:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+60:11619:x1873763958353408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.694917:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960842.694943:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c9803ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c223 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695153:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695170:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695184:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960842.695229:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1786960842.695354:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695388:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695396:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695401:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960842.695509:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695519:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695534:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960842.695538:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1786960842.695543:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695549:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695599:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c9803ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c223 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695611:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960842.695613:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786960842.695618:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c9803ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c223 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.695628:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926000, rc 0) 00000100:00100000:0.0:1786960842.695760:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353408:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 869us (1203us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1786960842.695768:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 217 00000100:00100000:3.0:1786960842.713259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.713402:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958353536 00000100:00100000:2.0:1786960842.713416:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958353536 00000100:00100000:2.0:1786960842.713501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:2.0:1786960842.713513:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353536:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786960842.713562:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786960842.713698:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353536:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 187us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.713707:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 218 00000100:00100000:1.0:1786960842.724928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.725041:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958353792 00000100:00100000:0.0:1786960842.725056:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958353792 00000100:00100000:0.0:1786960842.725145:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:0.0:1786960842.725158:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958353792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.725218:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960842.725223:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786960842.725258:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927000/0x1808d16e4c98036f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c207 expref: 61 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.725281:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960842.725287:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960842.725303:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c9803df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c22a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786960842.725842:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1786960842.726084:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.726100:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.726112:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.726175:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926000/0x1808d16e4c9803df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c22a expref: 63 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.726262:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c22a expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.726270:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9766559de000) 00010000:00010000:0.0:1786960842.726274:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960842.726276:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927200, rc 0) 00000100:00100000:0.0:1786960842.726368:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:11619:x1873763958353792:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1212us (1452us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1786960842.726378:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 219 00000100:00100000:3.0:1786960842.730851:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.731350:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354048 00000100:00100000:2.0:1786960842.731363:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354048 00000100:00100000:2.0:1786960842.731485:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:2.0:1786960842.731497:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:11619:x1873763958354048:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960842.731572:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960842.731621:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927200/0x1808d16e4c9803e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c22a expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.731640:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9766559de000) 00010000:00010000:2.0:1786960842.731652:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960842.731677:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.731692:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.731704:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.734473:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.734951:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.734965:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735048:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735055:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735061:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735067:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960842.735070:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735077:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735090:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:3.0:1786960842.735093:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960842.735098:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735121:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c9803f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735137:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735144:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735150:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735155:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960842.735158:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735164:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735172:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdb09ea69 (ffff976643e01500) 00010000:00010000:3.0:1786960842.735175:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960842.735178:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.735182:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168c00/0x1808d16e4c9803fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdb09ea69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.735534:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958354048:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 4034us (4693us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960842.735544:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 220 00000100:00100000:2.0:1786960842.739088:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.739181:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354176 00000100:00100000:3.0:1786960842.739262:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354176 00000100:00100000:3.0:1786960842.739630:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:3.0:1786960842.739642:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+61:11619:x1873763958354176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960842.739663:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960842.739687:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980402 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c231 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.739726:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.739739:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.739751:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.743459:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169000/0x1808d16e4c980402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 63 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.743506:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.743516:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960842.743519:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786960842.743523:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682168000, rc 0) 00000100:00100000:3.0:1786960842.743755:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:11619:x1873763958354176:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4115us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.743764:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 221 00000100:00100000:0.0:1786960842.750015:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.750508:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354432 00000100:00100000:1.0:1786960842.750524:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354432 00000100:00100000:1.0:1786960842.750594:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 222 00000100:00100000:1.0:1786960842.750605:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+62:11619:x1873763958354432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786960842.750705:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.750725:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.750738:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960842.751399:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1786960842.751501:0:8734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 324778313805ns, next at 325778309818ns, rc = 0 00000004:00010000:1.0:1786960842.751611:0:8734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053126dfa reply state 000000002fc8dd2f transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.751622:0:8734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786960842.751757:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+64:11619:x1873763958354432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 1150us (1746us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1786960842.751765:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 222 00010000:00010000:3.0:1786960842.754666:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754682:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754690:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754697:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960842.754702:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754710:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754728:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960842.754732:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960842.754737:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.754744:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.755716:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.756311:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354560 00000100:00100000:2.0:1786960842.756321:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354560 00000100:00100000:2.0:1786960842.756373:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:2.0:1786960842.756382:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+63:11619:x1873763958354560:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960842.756402:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960842.756421:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c238 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.756474:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 64 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.756487:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 64 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.760604:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960842.760607:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960842.760611:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ee00, rc 0) 00000100:00100000:2.0:1786960842.760691:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+64:11619:x1873763958354560:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 4305us (4975us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.760701:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 223 00000100:00100000:1.0:1786960842.767030:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.767120:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354688 00000100:00100000:2.0:1786960842.767130:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354688 00000100:00100000:2.0:1786960842.767238:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1786960842.767249:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2343:x1873763958354688:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1786960842.767775:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2343:x1873763958354688:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 525us (751us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1786960842.767784:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00080000:1.0:1786960842.768068:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960842.770746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.771595:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958354944 00000100:00100000:2.0:1786960842.771606:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958354944 00000100:00100000:2.0:1786960842.771673:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:2.0:1786960842.771683:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+64:11619:x1873763958354944:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786960842.771945:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+65:11619:x1873763958354944:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 262us (1207us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1786960842.771953:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:0.0:1786960842.774061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.774179:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355200 00000100:00100000:3.0:1786960842.774222:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355200 00000100:00100000:3.0:1786960842.774280:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:3.0:1786960842.774290:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+65:11619:x1873763958355200:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786960842.774403:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+65:11619:x1873763958355200:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.774427:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 224 00000100:00100000:1.0:1786960842.783735:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.783842:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355328 00000100:00100000:2.0:1786960842.783852:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355328 00000100:00100000:2.0:1786960842.783913:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:2.0:1786960842.783923:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+65:11619:x1873763958355328:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960842.783958:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960842.783981:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c98041e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c23f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784064:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784077:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784089:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960842.784127:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960842.784144:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784170:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5f400/0x1808d16e4c98041e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c23f expref: 67 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784230:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c23f expref: 66 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.784240:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960842.784242:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786960842.784245:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e400, rc 0) 00000100:00100000:2.0:1786960842.784312:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+66:11619:x1873763958355328:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 390us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.784319:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 225 00000100:00100000:2.0:1786960842.787111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.787231:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355456 00000100:00100000:1.0:1786960842.787241:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355456 00000100:00100000:1.0:1786960842.787294:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:1.0:1786960842.787303:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+10:2343:x1873763958355456:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786960842.787321:0:8239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960842.787340:0:8239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c246 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960842.787365:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a82dbcb, blocks: 0x1 00010000:00010000:1.0:1786960842.787383:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1786960842.787387:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960842.787396:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 11 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.787413:0:8239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 11 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.787426:0:8239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92e00, rc 0) 00000100:00100000:1.0:1786960842.787481:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:2343:x1873763958355456:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 178us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960842.787488:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:1.0:1786960842.793848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960842.793931:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355712 00000100:00100000:3.0:1786960842.793940:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355712 00000100:00100000:3.0:1786960842.793996:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:3.0:1786960842.794004:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+66:11619:x1873763958355712:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786960842.794121:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+66:11619:x1873763958355712:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 116us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.794129:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 226 00000100:00100000:2.0:1786960842.798671:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.798764:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355840 00000100:00100000:0.0:1786960842.798774:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355840 00000100:00100000:0.0:1786960842.798843:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1786960842.798853:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:11619:x1873763958355840:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.798869:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960842.798887:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c24d expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.798916:0:6660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.798925:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960842.798930:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960842.798936:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.798985:0:6660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.798999:0:6660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960842.799013:0:6660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967776640:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960842.799115:0:6660:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960842.801399:0:6660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6660:1873763967776640:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960842.801434:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 12 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.801454:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927400, rc 0) 00000100:00100000:0.0:1786960842.801511:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:11619:x1873763958355840:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2659us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960842.801520:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1786960842.808503:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.808840:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958355968 00000100:00100000:2.0:1786960842.808850:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958355968 00010000:00010000:2.0:1786960842.808891:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960842.808936:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:2.0:1786960842.808947:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2344:x1873763958355968:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960842.808962:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960842.808986:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.809001:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.809167:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000144e16f6/0x1808d16e4c98042c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c246 expref: 12 pid: 8239 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.809215:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960842.809221:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960842.809229:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.809238:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.809290:0:6673:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 11 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960842.809305:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873763967776768:192.168.203.23@tcp:105: 00000100:00100000:2.0:1786960842.809575:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96180 going to sleep for 11 seconds 00000100:00100000:3.0:1786960842.816921:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6673:1873763967776768:192.168.203.23@tcp:105: 00010000:00010000:3.0:1786960842.816944:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960842.817000:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:2344:x1873763958355968:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 8055us (8506us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960842.817011:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:3.0:1786960842.828327:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.829846:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356096 00000100:00100000:0.0:1786960842.829857:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356096 00002000:00100000:0.0:1786960842.829914:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9766597a5880 x1873763958356096/t0(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:428/0 lens 504/0 e 0 to 0 dl 1786960853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960842.829926:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766597a5880 with x1873763958356096 ext(0->12) 00002000:00010000:0.0:1786960842.829931:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766597a5880 00000100:00100000:0.0:1786960842.829971:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1786960842.829995:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+11:2343:x1873763958356096:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1786960842.830476:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2343:x1873763958356096:12345-192.168.203.23@tcp:4:lhsmtool_posix.0 Request processed in 477us (2152us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1786960842.830484:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00002000:00100000:0.0:1786960842.830491:0:6665:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9766597a5880 x1873763958356096/t4294967320(0) o4->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:428/0 lens 504/448 e 0 to 0 dl 1786960853 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786960842.830499:0:6665:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9766597a5880 with x1873763958356096 ext(0->12) 00002000:00010000:0.0:1786960842.830503:0:6665:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9766597a5880 00000100:00100000:1.0:1786960842.839107:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.839234:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356224 00000100:00100000:2.0:1786960842.839244:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356224 00000100:00100000:2.0:1786960842.839296:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 227 00000100:00100000:2.0:1786960842.839306:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+66:11619:x1873763958356224:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786960842.887689:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:0.0:1786960842.887714:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1786960842.887751:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1786960842.887755:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1786960842.887770:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+49:11619:x1873763958356224:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 48459us (48666us total) trans 0 rc 0/0 00000020:00080000:0.0:1786960842.887770:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff976681687a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1786960842.887778:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976648cb5200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff976681687600 00000020:00080000:0.0:1786960842.887782:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976648cb5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff976681996400 00000100:00100000:3.0:1786960842.887803:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 227 00000001:00080000:0.0:1786960842.887820:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1786960842.887841:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766466cee40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1786960842.887844:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976648c39800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9766466ce600 00000020:00080000:0.0:1786960842.887847:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976648c39500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97665143b800 00000004:00080000:0.0:1786960842.887891:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1786960842.887927:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1786960842.888127:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1786960842.888264:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967776896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786960842.888315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960842.888843:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967776896 00000100:00100000:1.0:1786960842.888856:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967776896 00000100:00100000:1.0:1786960842.888896:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786960842.888904:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1873763967776896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786960842.888929:0:8239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:3.0:1786960842.888936:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786960842.888948:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967777024:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1786960842.888974:0:8239:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a82dbc9, atime: 0x6a82dbca, ctime: 0x6a82dbc9, blocks: 0x1 00010000:00010000:1.0:1786960842.888982:0:8239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.888987:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786960842.889001:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1786960842.889006:0:8239:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960842.889012:0:8239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.889027:0:8239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.889037:0:8239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.889044:0:8239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.889061:0:8239:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786960842.889090:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967777024 00000100:00100000:3.0:1786960842.889096:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967777024 00000100:00100000:3.0:1786960842.889134:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786960842.889143:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1873763967777024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786960842.889156:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1786960842.889179:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889213:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889222:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1786960842.889225:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786960842.889230:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889256:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 12 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889270:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 12 pid: 6658 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.889283:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766597a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967777280:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960842.889330:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22000 going to sleep for 11 seconds 00010000:00010000:3.0:1786960842.889341:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960842.889346:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889355:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960842.889359:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889379:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889397:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889405:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98043a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.889423:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960842.889425:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960842.889426:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960842.889851:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1873763967776896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 945us (1533us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786960842.889858:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786960842.889883:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667aeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960842.889914:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960842.890612:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967777152 00000100:00100000:3.0:1786960842.890618:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967777152 00000100:00100000:3.0:1786960842.890723:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786960842.890733:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1873763967777152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1786960842.890997:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1786960842.891001:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786960843 00002000:00010000:3.0:1786960842.891003:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786960842.891006:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1786960843 -> 1786960843 00002000:00010000:3.0:1786960842.891009:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1786960842.891062:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3287:x1873763967777152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 330us (1146us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1786960842.891070:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1786960842.891114:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766816c9500/2, rc 0, transno 4294967310 00000100:00100000:3.0:1786960842.891120:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967776896:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1786960842.891205:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97667aeadc00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1786960842.891211:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667aeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967777152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960842.891575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960842.891884:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356352 00000100:00100000:2.0:1786960842.891890:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356352 00000100:00100000:2.0:1786960842.891924:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:2.0:1786960842.891933:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2343:x1873763958356352:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1786960842.893326:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766597a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967777280:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960842.893350:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.894038:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.895273:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356480 00000100:00100000:1.0:1786960842.895284:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356480 00010000:00010000:1.0:1786960842.895324:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 14 pid: 6658 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.895472:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:1.0:1786960842.895485:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+14:2344:x1873763958356480:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960842.895500:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960842.895507:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 14 pid: 6658 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.895523:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 14 pid: 6658 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.895547:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000392159c5/0x1808d16e4c9801fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c1ac expref: 14 pid: 6658 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.895564:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960842.895569:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960842.895587:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.895596:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.895629:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960842.895685:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+13:2344:x1873763958356480:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 202us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960842.895694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00010000:00010000:3.0:1786960842.895761:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.895774:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.895785:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.895804:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.895824:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786960842.896977:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3285:x1873763967777024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7832us (7989us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1786960842.896987:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1786960842.897012:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960842.897019:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.897029:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960842.897033:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.897043:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.897068:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.897076:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c980441 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960842.897100:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960842.897102:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960842.897103:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786960842.897166:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97667aead180/2, rc 0, transno 4294967322 00000100:00100000:1.0:1786960842.897173:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667aead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967777024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786960842.945990:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766812d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+12:2343:x1873763958356352:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 54048us (54407us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960842.946002:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000001:00080000:0.0:1786960842.946590:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1786960842.946612:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1786960842.946618:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1786960842.950998:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.954920:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356736 00000100:00100000:0.0:1786960842.954935:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356736 00000100:00100000:0.0:1786960842.954997:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 228 00000100:00100000:0.0:1786960842.955008:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11619:x1873763958356736:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.955061:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960842.955087:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e400/0x1808d16e4c980425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c23f expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.955108:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:0.0:1786960842.955114:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960842.955142:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.955154:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.955163:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786960842.955436:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062d7bb00 reply state 00000000c1519263 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960842.955446:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786960842.955627:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:11619:x1873763958356736:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 619us (4636us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1786960842.955651:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 228 00010000:00010000:2.0:1786960842.969160:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969177:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969221:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969228:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960842.969245:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969253:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969270:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960842.969273:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960842.969277:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.969283:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926800/0x1808d16e4c980448 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.971328:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.973001:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958356864 00000100:00100000:0.0:1786960842.973014:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958356864 00000100:00100000:0.0:1786960842.973086:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1786960842.973098:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2341:x1873763958356864:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786960842.973358:0:6658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786960842.973362:0:6658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1786960843 -> 1786960842 00002000:00010000:0.0:1786960842.973364:0:6658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1786960842 00002000:00010000:0.0:1786960842.973367:0:6658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1786960843 -> 1786960842 00002000:00010000:0.0:1786960842.973369:0:6658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786960842.973435:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2341:x1873763958356864:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 340us (2114us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1786960842.973443:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1786960842.978052:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.978234:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357120 00000100:00100000:0.0:1786960842.978244:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357120 00000100:00100000:0.0:1786960842.978302:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:0.0:1786960842.978312:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:11619:x1873763958357120:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.978378:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.978396:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.978405:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.978454:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.978470:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 20 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960842.978485:0:5810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967777408:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960842.978632:0:5810:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96180 going to sleep for 11 seconds 00000100:00100000:1.0:1786960842.981358:0:5810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1873763967777408:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960842.981388:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960842.982956:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960842.989543:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357248 00000100:00100000:1.0:1786960842.989557:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357248 00010000:00010000:1.0:1786960842.989607:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 21 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960842.989713:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:1.0:1786960842.989725:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:2343:x1873763958357248:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960842.989740:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960842.989747:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 21 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989779:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 21 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989813:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682168000/0x1808d16e4c980409 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c231 expref: 21 pid: 5810 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989852:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:1.0:1786960842.989857:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989867:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989874:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960842.989910:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960842.989975:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:2343:x1873763958357248:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 253us (7025us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960842.989983:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00010000:00010000:2.0:1786960842.990415:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990424:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990468:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990475:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990482:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990488:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960842.990493:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990512:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990523:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:2.0:1786960842.990526:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786960842.990530:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960842.990536:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926600/0x1808d16e4c98044f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960842.990594:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11619:x1873763958357120:12345-192.168.203.23@tcp:55:lhsmtool_posix.0 Request processed in 12283us (12550us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786960842.990602:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 229 00000100:00100000:3.0:1786960842.994803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960842.994959:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357376 00000100:00100000:0.0:1786960842.994969:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357376 00000100:00100000:0.0:1786960842.995031:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1786960842.995042:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958357376:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786960842.995081:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.995101:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.995109:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786960842.995114:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786960842.995118:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.995150:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 8 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960842.995180:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 8 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960842.995232:0:6659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967777536:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960842.995303:0:6659:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667ac96180 going to sleep for 11 seconds 00010000:00010000:3.0:1786960842.997649:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960843.000039:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.000163:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357504 00000100:00100000:1.0:1786960843.000173:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357504 00010000:00010000:1.0:1786960843.000265:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 9 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960843.000313:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1786960843.000322:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2344:x1873763958357504:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960843.000350:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960843.000374:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 9 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.000388:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 9 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.000423:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960843.000428:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786960843.000434:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.000442:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.000461:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960843.000508:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+9:2344:x1873763958357504:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 186us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.000515:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00010000:00010000:3.0:1786960843.001256:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980433 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c24d expref: 8 pid: 6660 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.001273:0:6659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6659:1873763967777536:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960843.001294:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001305:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001324:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001351:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001360:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001368:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001376:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960843.001380:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001388:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001401:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.001473:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003915f609/0x1808d16e4c980456 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.001552:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958357376:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 6512us (6767us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960843.001560:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:0.0:1786960843.019031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960843.019231:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357760 00000100:00100000:3.0:1786960843.019241:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357760 00000100:00100000:3.0:1786960843.019294:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 230 00000100:00100000:3.0:1786960843.019303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11619:x1873763958357760:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786960843.019377:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019394:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019415:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019622:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019634:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019642:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019675:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.019720:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 20 pid: 5811 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.019734:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967777664:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960843.019816:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960843.023661:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967777664:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960843.023704:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960843.026558:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960843.026759:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958357888 00000100:00100000:3.0:1786960843.026767:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958357888 00010000:00010000:3.0:1786960843.026811:0:6673:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 21 pid: 5811 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.027001:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1786960843.027011:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:2343:x1873763958357888:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960843.027128:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960843.027136:0:6673:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 21 pid: 5811 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027150:0:6673:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 21 pid: 5811 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027172:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c238 expref: 21 pid: 5811 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027237:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960843.027242:0:6673:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027251:0:6673:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027258:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.027277:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960843.027374:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.027382:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960843.027553:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1786960843.027671:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000100:00100000:3.0:1786960843.027752:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d17850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2343:x1873763958357888:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 741us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960843.027760:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000001:00080000:0.0:1786960843.028520:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1786960843.028604:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967777792:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786960843.028660:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960843.028697:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648efc300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960843.030872:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967777792 00000100:00100000:3.0:1786960843.030883:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967777792 00000100:00100000:3.0:1786960843.030955:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786960843.030965:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967777792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1786960843.031108:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967777792:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960843.031115:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1786960843.031968:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960843.032008:0:5812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1786960843.032014:0:5812:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1786960843.032044:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97667aeadc00, transno 4294967321 00000004:00080000:0.0:1786960843.032052:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97667aead180, transno 4294967322 00000100:00100000:0.0:1786960843.032059:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967777792:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1786960843.033264:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1786960843.033341:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967777920:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1786960843.033398:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960843.033996:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960843.038932:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967777920 00000100:00100000:3.0:1786960843.038945:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967777920 00000100:00100000:2.0:1786960843.039219:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786960843.039229:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1873763967777920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786960843.039487:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1873763967777920:12345-0@lo:1000:mdt00_002.0 Request processed in 259us (6087us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1786960843.039495:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960843.039575:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5812:1873763967777920:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1786960843.039612:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039622:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039642:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039648:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960843.039653:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039660:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039675:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976643e01a00) 00010000:00010000:3.0:1786960843.039677:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960843.039681:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039699:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045400/0x1808d16e4c980464 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039726:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039733:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039738:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039743:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ec00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960843.039745:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039759:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039768:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960843.039770:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960843.039777:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039797:0:5812:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039807:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.039854:0:5812:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.039868:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967778048:192.168.203.23@tcp:105: 00000100:00100000:3.0:1786960843.039948:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655a22e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960843.045622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960843.045730:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1873763967778048:192.168.203.23@tcp:105: 00010000:00010000:3.0:1786960843.045755:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045765:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ec00/0x1808d16e4c9803a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045807:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045848:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045861:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045872:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045878:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045885:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045892:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960843.045895:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045902:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045912:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960843.045915:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960843.045919:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045924:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c98046b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045935:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045946:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045951:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045956:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960843.045959:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045964:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045972:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960843.045974:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786960843.045977:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960843.045982:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682044a00/0x1808d16e4c98045d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960843.046221:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11619:x1873763958357760:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 26917us (30400us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1786960843.046232:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 230 00000020:00080000:3.0:1786960843.046238:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786960843.046499:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960843.046503:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960843.046534:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1786960843.046541:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786960843.046777:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958358016 00000100:00100000:1.0:1786960843.046784:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958358016 00000100:00100000:1.0:1786960843.046851:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1786960843.046860:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11618:x1873763958358016:12345-192.168.203.23@tcp:49:lfs.0 00000100:00100000:1.0:1786960843.046953:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11618:x1873763958358016:12345-192.168.203.23@tcp:49:lfs.0 Request processed in 95us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.046960:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1786960843.051458:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960843.051540:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958358272 00000100:00100000:3.0:1786960843.051550:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958358272 00000100:00100000:3.0:1786960843.051610:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:3.0:1786960843.051620:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11618:x1873763958358272:12345-192.168.203.23@tcp:58:lfs.0 00000040:00080000:3.0:1786960843.052001:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1786960843.052096:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11618:x1873763958358272:12345-192.168.203.23@tcp:58:lfs.0 Request processed in 477us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960843.052103:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 231 00000100:00100000:1.0:1786960843.059652:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960843.059747:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958358528 00000100:00100000:2.0:1786960843.059757:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958358528 00000100:00100000:2.0:1786960843.059833:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:2.0:1786960843.059849:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+23:11619:x1873763958358528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786960843.060533:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786960843.060644:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1786960843.060688:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060716:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060727:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060735:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060742:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060748:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960843.060764:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786960843.060861:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:11619:x1873763958358528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1217us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1786960843.060869:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000020:00080000:2.0:1786960843.060874:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786960843.061129:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960843.061136:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.061143:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5ea00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960843.061147:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.061155:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.061167:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff976664f8c900) 00010000:00010000:0.0:1786960843.061169:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786960843.061174:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.061179:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ea00/0x1808d16e4c980472 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.061216:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960843.061218:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960843.061227:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960843.100894:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.101048:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958358656 00000100:00100000:1.0:1786960843.101058:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958358656 00000100:00100000:1.0:1786960843.101115:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 232 00000100:00100000:1.0:1786960843.101134:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+25:11621:x1873763958358656:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960843.101156:0:8734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960843.101174:0:8734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980479 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c254 expref: -99 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101266:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101280:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101291:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101306:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101312:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101318:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101631:0:8734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101643:0:8734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 26 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.101660:0:8734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.102653:0:8734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 26 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.102674:0:8734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 26 pid: 8734 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960843.102701:0:8734:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667aeae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967778176:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960843.102806:0:8734:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766816873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960843.111274:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960843.111361:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958358912 00000100:00100000:2.0:1786960843.111369:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958358912 00000100:00100000:0.0:1786960843.111377:0:8734:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667aeae680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8734:1873763967778176:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960843.111413:0:8734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960843.111436:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1786960843.111446:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:5581:x1873763958358912:12345-192.168.203.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786960843.111677:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:5581:x1873763958358912:12345-192.168.203.23@tcp:35:ldlm_bl.0 Request processed in 232us (416us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1786960843.111685:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:2.0:1786960843.116437:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.116722:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359040 00000100:00100000:1.0:1786960843.116732:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359040 00010000:00010000:1.0:1786960843.116780:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 28 pid: 8734 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960843.117009:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1786960843.117021:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:2344:x1873763958359040:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960843.117036:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960843.117043:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 28 pid: 8734 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117057:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 28 pid: 8734 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117091:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92800/0x1808d16e4c980399 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c215 expref: 28 pid: 8734 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117105:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:1.0:1786960843.117110:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117119:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117126:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960843.117161:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960843.117266:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:2344:x1873763958359040:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 247us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.117275:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00010000:00010000:0.0:1786960843.118172:0:8734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118182:0:8734:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960843.118256:0:8734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1786960843.118260:0:8734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960843.118280:0:8734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118292:0:8734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118302:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118308:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118314:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118319:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960843.118322:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118344:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118369:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960843.118371:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960843.118375:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118381:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92400/0x1808d16e4c980480 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118530:0:8734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118536:0:8734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118542:0:8734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118547:0:8734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960843.118551:0:8734:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118557:0:8734:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118564:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff976661496900) 00010000:00010000:0.0:1786960843.118567:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960843.118570:0:8734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118586:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92a00/0x1808d16e4c980487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118638:0:8734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93800/0x1808d16e4c980479 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c254 expref: 27 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118653:0:8734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c254 expref: 26 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960843.118660:0:8734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960843.118663:0:8734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960843.118665:0:8734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92200, rc 0) 00000100:00100000:0.0:1786960843.118721:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11621:x1873763958358656:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 17588us (17835us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960843.118729:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 232 00000040:00080000:0.0:1786960843.863831:0:12587:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960843.863840:0:12587:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960843.863887:0:12587:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1786960843.863895:0:12587:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786960843.945732:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.945773:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.945813:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.945833:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.945855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960843.945880:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359552 00000100:00100000:1.0:1786960843.945890:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359552 00000100:00100000:1.0:1786960843.945944:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359424 00000100:00100000:1.0:1786960843.945947:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359424 00000100:00100000:1.0:1786960843.945969:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1786960843.945979:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958359552:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960843.946121:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958359552:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 142us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.946129:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1786960843.946146:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:1.0:1786960843.946153:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958359424:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960843.946178:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958359424:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.946210:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:1.0:1786960843.946228:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359168 00000100:00100000:1.0:1786960843.946231:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359168 00000100:00100000:1.0:1786960843.946256:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 300 00000100:00100000:1.0:1786960843.946262:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958359168:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960843.946287:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958359168:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960843.946293:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 300 00000100:00100000:1.0:1786960843.946335:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359296 00000100:00100000:1.0:1786960843.946339:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359296 00000100:00100000:1.0:1786960843.946479:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359680 00000100:00100000:1.0:1786960843.946482:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359680 00000100:00100000:2.0:1786960843.950300:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:2.0:1786960843.950332:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:2343:x1873763958359296:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960843.950425:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:2343:x1873763958359296:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 112us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960843.950433:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 166 00000100:00100000:2.0:1786960843.950457:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00100000:2.0:1786960843.950468:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958359680:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960843.950493:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2343:x1873763958359680:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (4638us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960843.950499:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 167 00000100:00080000:0.0:1786960843.955247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786960843.955259:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786960844.023705:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786960844.084643:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960844.084652:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960844.084696:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1786960844.084705:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786960844.084845:0:11653:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967778304:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786960844.086761:0:11653:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960844.106741:0:11653:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11653:1873763967778304:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786960844.122913:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960844.122979:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958359808 00000100:00100000:2.0:1786960844.122989:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958359808 00000100:00100000:2.0:1786960844.123106:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00100000:2.0:1786960844.123119:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11633:x1873763958359808:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786960844.123169:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786960844.123313:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11633:x1873763958359808:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 197us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960844.123323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 233 00000100:00080000:0.0:1786960844.123379:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960844.135314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960844.135406:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958360064 00000100:00100000:2.0:1786960844.135415:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958360064 00000100:00100000:2.0:1786960844.135496:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:2.0:1786960844.135508:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+26:11633:x1873763958360064:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960844.135528:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960844.135549:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980495 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c25b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960844.135683:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98049c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960844.135697:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960844.135709:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98049c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960844.135720:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786960844.135856:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980495 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c25b expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960844.135875:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98049c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c25b expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960844.135884:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:2.0:1786960844.135887:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960844.135891:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960844.135951:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:11633:x1873763958360064:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 446us (647us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1786960844.135959:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 234 00000100:00100000:3.0:1786960844.139856:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960844.139958:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958360192 00000100:00100000:1.0:1786960844.139968:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958360192 00000100:00100000:1.0:1786960844.140034:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1786960844.140044:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:2343:x1873763958360192:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960844.140059:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960844.140094:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c98049c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c25b expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960844.140113:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:1.0:1786960844.140118:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960844.140179:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:2343:x1873763958360192:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960844.140737:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1786960844.162406:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960844.162581:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958360448 00000100:00100000:3.0:1786960844.162591:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958360448 00000100:00100000:3.0:1786960844.162649:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 235 00000100:00100000:3.0:1786960844.162658:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+27:11633:x1873763958360448:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1786960844.162733:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162751:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162763:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162958:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162967:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162973:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.162979:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960844.162984:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.163003:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.163309:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960844.163313:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786960844.163319:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960844.163326:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960844.163473:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:11633:x1873763958360448:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 813us (1073us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1786960844.163482:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 235 00000040:00080000:0.0:1786960844.164127:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960844.164367:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1786960844.165431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960844.165509:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958360704 00000100:00100000:1.0:1786960844.165518:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958360704 00000100:00100000:1.0:1786960844.165568:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1786960844.165578:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+28:11633:x1873763958360704:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786960844.165796:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:11633:x1873763958360704:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 219us (369us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1786960844.165805:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000040:00080000:0.0:1786960844.165897:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1786960844.165909:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1786960845.044523:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786960845.716981:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1786960845.717011:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:1.0:1786960845.850614:0:12638:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786960845.850624:0:12638:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786960845.850673:0:12638:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1786960845.850679:0:12638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786960845.945706:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960845.946405:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958360960 00000100:00100000:1.0:1786960845.946419:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958360960 00000100:00100000:1.0:1786960845.946492:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1786960845.946503:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+29:11653:x1873763958360960:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960845.946535:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960845.946563:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c9804b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c262 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960845.946723:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9804b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960845.946741:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9804b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960845.946755:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9804b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960845.946767:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1786960845.946943:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92c00/0x1808d16e4c9804b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c262 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960845.946965:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9804b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c262 expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960845.946976:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:1.0:1786960845.946980:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786960845.946984:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93000, rc 0) 00000100:00100000:1.0:1786960845.947066:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:11653:x1873763958360960:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 564us (1374us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1786960845.947075:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 236 00000100:00100000:1.0:1786960845.951779:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960845.951831:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361088 00000100:00100000:3.0:1786960845.951842:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361088 00000100:00100000:3.0:1786960845.951911:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:3.0:1786960845.951921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:11653:x1873763958361088:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1786960845.952059:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952080:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952095:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952130:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952146:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952154:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952162:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960845.952167:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952175:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952212:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:3.0:1786960845.952215:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786960845.952220:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960845.952225:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682045a00/0x1808d16e4c9804c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960845.952366:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+31:11653:x1873763958361088:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 444us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960845.952374:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 237 00000100:00100000:0.0:1786960846.009987:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960846.010756:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361216 00000100:00100000:3.0:1786960846.010778:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361216 00000100:00100000:3.0:1786960846.010971:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00100000:3.0:1786960846.010983:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958361216:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1786960846.011007:0:6660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960846.011043:0:6660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9804cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c269 expref: -99 pid: 6660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786960846.011078:0:6660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a82dbca, atime: 0x6a82dbca, ctime: 0x6a82dbca, blocks: 0xb 00010000:00010000:3.0:1786960846.011107:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1786960846.011113:0:6660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960846.011124:0:6660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9804cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c269 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960846.011147:0:6660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9804cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c269 expref: 8 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960846.011163:0:6660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045a00, rc 0) 00000100:00100000:3.0:1786960846.011261:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2344:x1873763958361216:12345-192.168.203.23@tcp:101:cat.0 Request processed in 280us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960846.011269:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 71 00000100:00080000:0.0:1786960846.011487:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960846.020638:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960846.020850:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361344 00000100:00100000:3.0:1786960846.020862:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361344 00002000:00100000:3.0:1786960846.020930:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97667aeaf100 x1873763958361344/t0(0) o3->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:432/0 lens 488/0 e 0 to 0 dl 1786960857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960846.020944:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97667aeaf100 with x1873763958361344 ext(0->4095) 00002000:00010000:3.0:1786960846.020950:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97667aeaf100 00000100:00100000:3.0:1786960846.020989:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1786960846.020999:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958361344:12345-192.168.203.23@tcp:3:cat.0 00000100:00100000:3.0:1786960846.021282:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+8:2343:x1873763958361344:12345-192.168.203.23@tcp:3:cat.0 Request processed in 283us (665us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786960846.021313:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00002000:00100000:3.0:1786960846.021321:0:6664:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97667aeaf100 x1873763958361344/t0(0) o3->e2d64e27-0ccc-4195-8812-2a972b8bf63c@192.168.203.23@tcp:432/0 lens 488/4536 e 0 to 0 dl 1786960857 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786960846.021330:0:6664:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97667aeaf100 with x1873763958361344 ext(0->4095) 00002000:00010000:3.0:1786960846.021333:0:6664:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97667aeaf100 00010000:00010000:1.0:1786960846.072178:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960846.644471:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960846.644501:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967778432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960846.644594:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960846.644728:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967778432 00000100:00100000:0.0:1786960846.644738:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967778432 00000100:00100000:0.0:1786960846.644818:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786960846.644828:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967778432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960846.644874:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960846.644957:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1873763967778432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960846.644965:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1786960846.645215:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960846.645258:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967778432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960846.646787:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967778560:0@lo:400:kworker.0 00000100:00100000:1.0:1786960846.646869:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960846.647047:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967778688:0@lo:400:kworker.0 00000100:00100000:0.0:1786960846.647056:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967778560 00000100:00100000:0.0:1786960846.647067:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967778560 00000100:00100000:3.0:1786960846.647091:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960846.647130:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1786960846.647141:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967778560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647180:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967778688 00000100:00100000:3.0:1786960846.647220:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967778688 00000100:00100000:3.0:1786960846.647259:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1786960846.647267:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967778688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647313:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976681705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967778688:12345-0@lo:400:kworker.0 Request processed in 46us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960846.647321:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1786960846.647385:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967778688:0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647406:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786960846.647413:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976647b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967779072:0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960846.647476:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967778816:0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960846.647536:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786960846.647544:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ad31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967778944:0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960846.647581:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779072 00000100:00100000:2.0:1786960846.647588:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779072 00000100:00100000:3.0:1786960846.647600:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967778816 00000100:00100000:3.0:1786960846.647606:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967778816 00000100:00100000:3.0:1786960846.647641:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967778944 00000100:00100000:3.0:1786960846.647644:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967778944 00000100:00100000:2.0:1786960846.647648:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1786960846.647659:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967779072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647674:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1786960846.647682:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967778816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960846.647722:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967779072:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960846.647731:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1786960846.647736:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967778816:12345-0@lo:400:kworker.0 Request processed in 53us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960846.647744:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1786960846.647760:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1786960846.647781:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967778944:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786960846.647789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786960846.647796:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960846.647815:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766813e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967778944:12345-0@lo:400:kworker.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960846.647823:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1786960846.647826:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1786960846.647834:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1786960846.647857:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766816c9500, transno 4294967310 00000100:00100000:3.0:1786960846.647858:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967778944:0@lo:400:kworker.0 00000100:00100000:2.0:1786960846.647875:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976647b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967779072:0@lo:400:kworker.0 00000100:00100000:3.0:1786960846.647876:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ad32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967778816:0@lo:400:kworker.0 00000100:00100000:1.0:1786960846.648700:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3f21e71-ba64-41c6-8589-43a20e36767f:3285:1873763967778560:0@lo:400:kworker.0 00000100:00100000:0.0:1786960846.648702:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e629c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3285:x1873763967778560:12345-0@lo:400:kworker.0 Request processed in 1560us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960846.648717:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00010000:3.0:1786960847.096725:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960847.156486:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960847.156519:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967779200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960847.156609:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960847.156829:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779200 00000100:00100000:0.0:1786960847.156840:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779200 00000100:00100000:0.0:1786960847.156920:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786960847.156943:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967779200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960847.157009:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960847.157065:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967779200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960847.157073:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786960847.157272:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967779200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1786960848.117702:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786960848.281017:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1786960848.281073:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1786960848.283353:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000020:00080000:0.0:1786960848.283366:0:5833:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9766466cef00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1786960848.283372:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976677212700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9766466ce780 00000020:00080000:0.0:1786960848.283376:0:5833:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff976677212a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97664e7ce000 00000020:00080000:0.0:1786960848.283402:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1786960848.283410:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1786960848.283891:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1786960848.287180:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1786960849.047389:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960849.047436:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960849.047477:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960849.047503:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960849.047531:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960849.047574:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361984 00000100:00100000:3.0:1786960849.047584:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361984 00000100:00100000:3.0:1786960849.047640:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361600 00000100:00100000:3.0:1786960849.047643:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361600 00000100:00100000:3.0:1786960849.047666:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1786960849.047676:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958361984:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960849.047747:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:2344:x1873763958361984:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960849.047767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1786960849.047784:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1786960849.047791:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958361600:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960849.047819:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958361600:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960849.047825:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 172 00000100:00100000:3.0:1786960849.047843:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361728 00000100:00100000:3.0:1786960849.047846:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361728 00000100:00100000:3.0:1786960849.047867:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361856 00000100:00100000:3.0:1786960849.047870:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361856 00000100:00100000:3.0:1786960849.047887:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:3.0:1786960849.047893:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958361728:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960849.047917:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ad32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2344:x1873763958361728:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960849.047923:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:3.0:1786960849.047933:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1786960849.047938:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958361856:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960849.047958:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976673ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958361856:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 20us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960849.047971:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:1.0:1786960849.048075:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958361472 00000100:00100000:1.0:1786960849.048080:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958361472 00000100:00100000:1.0:1786960849.048105:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 302 00000100:00100000:1.0:1786960849.048111:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958361472:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960849.048141:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2344:x1873763958361472:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960849.048147:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 302 00000100:00080000:0.0:1786960849.048271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786960849.048276:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786960849.048278:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786960849.140471:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960850.170215:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960850.249660:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960850.249985:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362112 00000100:00100000:3.0:1786960850.249995:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362112 00000100:00100000:3.0:1786960850.250060:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:3.0:1786960850.250071:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11298:x1873763958362112:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1786960850.250174:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11298:x1873763958362112:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 105us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960850.250181:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 238 00000100:00100000:0.0:1786960850.258314:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960850.258435:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362368 00000100:00100000:3.0:1786960850.258444:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362368 00000100:00100000:3.0:1786960850.258500:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:3.0:1786960850.258510:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:11298:x1873763958362368:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786960850.259037:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:11298:x1873763958362368:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 528us (732us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1786960850.259045:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:1.0:1786960850.471482:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960850.471672:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362496 00000100:00100000:0.0:1786960850.471916:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362496 00000100:00100000:0.0:1786960850.472041:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 239 00000100:00100000:0.0:1786960850.472052:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+5:12105:x1873763958362496:12345-192.168.203.23@tcp:101:lsof.0 00010000:00010000:0.0:1786960850.472073:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960850.472096:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c9804d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c270 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.472161:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.472175:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.472830:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786960850.473165:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786960850.473170:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786960850.474085:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.474124:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c9804d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c270 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.474142:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c270 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960850.474151:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:0.0:1786960850.474154:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960850.474158:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926c00, rc 0) 00000100:00100000:0.0:1786960850.474276:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:12105:x1873763958362496:12345-192.168.203.23@tcp:101:lsof.0 Request processed in 2224us (2807us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960850.474283:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 239 00010000:00010000:3.0:1786960851.188474:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960851.765548:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967779712:0@lo:400:kworker.0 00000100:00100000:3.0:1786960851.765648:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960851.765728:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786960851.765745:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967779584:0@lo:400:kworker.0 00000100:00100000:3.0:1786960851.765771:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960851.765787:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967780096:0@lo:400:kworker.0 00000100:00100000:3.0:1786960851.765813:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960851.765873:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780096 00000100:00100000:3.0:1786960851.765882:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780096 00000100:00100000:2.0:1786960851.766033:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967779456:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766078:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960851.766105:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967779968:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766128:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960851.766147:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1786960851.766152:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967779328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960851.766177:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960851.766215:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967779840:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766237:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960851.766276:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779712 00000100:00100000:2.0:1786960851.766280:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779712 00000100:00100000:2.0:1786960851.766338:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779584 00000100:00100000:2.0:1786960851.766342:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779584 00000100:00100000:2.0:1786960851.766355:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779968 00000100:00100000:2.0:1786960851.766357:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779968 00000100:00100000:2.0:1786960851.766376:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1786960851.766386:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967779712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766461:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1873763967779712:12345-0@lo:400:kworker.0 Request processed in 75us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766468:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1786960851.766487:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1786960851.766492:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967779584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766522:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967779584:12345-0@lo:400:kworker.0 Request processed in 29us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766527:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1786960851.766538:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786960851.766544:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967779968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766571:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976647b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967779968:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766576:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786960851.766594:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779456 00000100:00100000:2.0:1786960851.766598:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779456 00000100:00100000:2.0:1786960851.766619:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1786960851.766625:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967779456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766652:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3288:x1873763967779456:12345-0@lo:400:kworker.0 Request processed in 28us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766658:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1786960851.766691:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779328 00000100:00100000:2.0:1786960851.766694:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779328 00000100:00100000:2.0:1786960851.766722:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786960851.766744:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967779328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960851.766779:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960851.766815:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967779328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766829:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786960851.766849:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967779840 00000100:00100000:2.0:1786960851.766853:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967779840 00000100:00100000:2.0:1786960851.766877:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786960851.766884:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967779840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.766928:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967779840:12345-0@lo:400:kworker.0 Request processed in 45us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960851.766934:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1786960851.766950:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786960851.766955:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960851.766988:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1786960851.766995:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1786960851.767030:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967779328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960851.767042:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967779840:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.767051:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967779456:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.767059:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967779968:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.767130:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674117800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967779584:0@lo:400:kworker.0 00000100:00100000:2.0:1786960851.767140:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674116300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967779712:0@lo:400:kworker.0 00000100:00100000:3.0:1786960851.768164:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1786960851.768178:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967780096:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786960851.768534:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960851.768769:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967780096:12345-0@lo:400:kworker.0 Request processed in 594us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960851.768779:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786960851.771805:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967780096:0@lo:400:kworker.0 00010000:00010000:1.0:1786960852.212810:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960852.276412:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960852.276444:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967780224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960852.276543:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960852.276927:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780224 00000100:00100000:2.0:1786960852.276938:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780224 00000100:00100000:2.0:1786960852.276998:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786960852.277009:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967780224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960852.277054:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960852.277138:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967780224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960852.277156:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786960852.277485:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967780224:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1786960852.932411:0:12840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:00:52 (1786960852) 00010000:00010000:3.0:1786960853.239086:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1786960853.354874:0:5833:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1786960853.355054:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1786960853.355067:0:5845:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1786960853.355797:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000040:00080000:2.0:1786960853.367559:0:11653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786960853.367571:0:11653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960853.368698:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1786960853.368710:0:11653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786960854.165733:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960854.165818:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960854.165858:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960854.165881:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960854.165904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960854.165944:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958363008 00000100:00100000:3.0:1786960854.165954:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958363008 00000100:00100000:3.0:1786960854.166011:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362880 00000100:00100000:3.0:1786960854.166014:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362880 00000100:00100000:3.0:1786960854.166038:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1786960854.166048:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958363008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960854.166113:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2344:x1873763958363008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 67us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960854.166120:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1786960854.166136:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:3.0:1786960854.166142:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958362880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960854.166179:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2343:x1873763958362880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960854.166210:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:3.0:1786960854.166241:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362752 00000100:00100000:3.0:1786960854.166245:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362752 00000100:00100000:3.0:1786960854.166269:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958363136 00000100:00100000:3.0:1786960854.166272:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958363136 00000100:00100000:3.0:1786960854.166291:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:3.0:1786960854.166298:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958362752:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960854.166330:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:2344:x1873763958362752:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960854.166336:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 176 00000100:00100000:3.0:1786960854.166347:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00100000:3.0:1786960854.166353:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2344:x1873763958363136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960854.166373:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2344:x1873763958363136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960854.166379:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 177 00000100:00080000:3.0:1786960854.166396:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786960854.166401:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960854.166403:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960854.166586:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958362624 00000100:00100000:2.0:1786960854.166590:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958362624 00000100:00100000:2.0:1786960854.166623:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 304 00000100:00100000:2.0:1786960854.166629:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958362624:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960854.166661:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+13:2343:x1873763958362624:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960854.166667:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 304 00010000:00010000:1.0:1786960854.260360:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960855.285519:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960856.308434:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960856.343429:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.343487:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958363392 00000100:00100000:3.0:1786960856.343498:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958363392 00000100:00100000:3.0:1786960856.343564:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:3.0:1786960856.343575:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+18:12326:x1873763958363392:12345-192.168.203.23@tcp:35:umount.0 00000100:00080000:2.0:1786960856.343616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960856.344240:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:12326:x1873763958363392:12345-192.168.203.23@tcp:35:umount.0 Request processed in 662us (816us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1786960856.344251:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:3.0:1786960856.350335:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960856.350452:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958363648 00000100:00100000:0.0:1786960856.350466:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958363648 00000100:00100000:0.0:1786960856.350547:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:0.0:1786960856.350560:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+19:12326:x1873763958363648:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:0.0:1786960856.351458:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:12326:x1873763958363648:12345-192.168.203.23@tcp:35:umount.0 Request processed in 891us (1125us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1786960856.351473:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:1.0:1786960856.355493:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.355656:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958363904 00000100:00100000:3.0:1786960856.355685:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958363904 00000100:00100000:3.0:1786960856.357293:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:3.0:1786960856.357310:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976645c23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+20:12326:x1873763958363904:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:3.0:1786960856.358051:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976645c23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:12326:x1873763958363904:12345-192.168.203.23@tcp:35:umount.0 Request processed in 742us (2570us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1786960856.358061:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00100000:1.0:1786960856.363108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960856.363391:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958364160 00000100:00100000:0.0:1786960856.363402:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958364160 00000100:00100000:0.0:1786960856.363458:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:0.0:1786960856.363468:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+21:12326:x1873763958364160:12345-192.168.203.23@tcp:35:umount.0 00000100:00100000:0.0:1786960856.363852:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:12326:x1873763958364160:12345-192.168.203.23@tcp:35:umount.0 Request processed in 384us (752us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1786960856.363859:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:2.0:1786960856.374668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960856.374725:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960856.374811:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.374914:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958364288 00000100:00100000:1.0:1786960856.374917:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958364416 00000100:00100000:0.0:1786960856.374928:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958364544 00000100:00100000:1.0:1786960856.374932:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958364416 00000100:00100000:0.0:1786960856.374943:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958364544 00000100:00100000:0.0:1786960856.375007:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1786960856.375018:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+14:2344:x1873763958364544:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1786960856.375045:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1786960856.375054:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+14:2342:x1873763958364416:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960856.375092:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960856.375093:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960856.375114:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97667ae5f200/0x1808d16e4c97f73d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bec6 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.375115:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a200/0x1808d16e4c97f4b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdc3 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.375133:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786960856.375139:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960856.375291:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:2342:x1873763958364416:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 237us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960856.375299:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1786960856.375410:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958364288 00000100:00100000:3.0:1786960856.375480:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1786960856.375494:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:2342:x1873763958364288:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960856.375513:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1786960856.375531:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+12:2344:x1873763958364544:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 507us (713us total) trans 0 rc 0/0 00010000:00010000:3.0:1786960856.375542:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682168400/0x1808d16e4c97f553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bdfb expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960856.375560:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00010000:00010000:3.0:1786960856.376008:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960856.378348:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958364288:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 2847us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960856.378363:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1786960856.380824:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.381285:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958364672 00000100:00100000:3.0:1786960856.381303:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958364672 00000100:00100000:3.0:1786960856.381408:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00100000:3.0:1786960856.381421:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+5:2340:x1873763958364672:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:3.0:1786960856.381465:0:6659:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f82b 00000100:00080000:3.0:1786960856.381476:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9766818d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960856.381535:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1786960856.381679:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960856.381912:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e2d64e27-0ccc-4195-8812-2a972b8bf63c+2:2340:x1873763958364672:12345-192.168.203.23@tcp:9:umount.0 Request processed in 492us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960856.381921:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 72 00000100:00080000:2.0:1786960856.382080:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786960856.390682:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.391047:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958365056 00000100:00100000:3.0:1786960856.391058:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958365056 00000100:00100000:3.0:1786960856.391162:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:3.0:1786960856.391175:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2340:x1873763958365056:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:3.0:1786960856.391234:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97fa93 00000020:00010000:3.0:1786960856.391243:0:6658:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9766520b1800: total 0 00000100:00080000:3.0:1786960856.391248:0:6658:0:(import.c:65:import_set_state_nolock()) ffff9766520b3000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1786960856.391264:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1786960856.391294:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1786960856.391356:0:5798:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9766520b1800: total 0 00010000:00010000:1.0:1786960856.391409:0:5798:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9766520b1800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1786960856.391465:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c97fe2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c09b expref: 6 pid: 8239 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960856.391501:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9804cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c269 expref: 6 pid: 6660 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960856.391520:0:5798:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9766520b1800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1786960856.391533:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960856.391535:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960856.391537:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960856.391605:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e2d64e27-0ccc-4195-8812-2a972b8bf63c+2:2340:x1873763958365056:12345-192.168.203.23@tcp:9:umount.0 Request processed in 433us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960856.391617:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 73 00000100:00100000:1.0:1786960856.400111:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960856.400311:0:8734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366080 00000100:00100000:3.0:1786960856.400322:0:8734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366080 00000100:00100000:3.0:1786960856.400390:0:8734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:3.0:1786960856.400409:0:8734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+22:2340:x1873763958366080:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1786960856.400440:0:8734:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f4c7 00000020:00010000:3.0:1786960856.400458:0:8734:0:(genops.c:1942:obd_stale_export_put()) Put export ffff976664d29800: total 0 00000100:00080000:3.0:1786960856.400463:0:8734:0:(import.c:65:import_set_state_nolock()) ffff97667ab11800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786960856.400536:0:8734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1786960856.401129:0:5799:0:(genops.c:1928:obd_stale_export_get()) Get export ffff976664d29800: total 0 00010000:00010000:0.0:1786960856.401135:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960856.401176:0:5799:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff976664d29800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1786960856.401273:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:0.0:1786960856.401277:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960856.401286:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92000/0x1808d16e4c97fe91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0b7 expref: 21 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401304:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976643e01000) 00010000:00010000:0.0:1786960856.401306:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960856.401310:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c97f7ad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bedb expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401326:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960856.401328:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960856.401332:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0600/0x1808d16e4c97fdf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c086 expref: 19 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401357:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960856.401360:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786960856.401364:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92200/0x1808d16e4c98048e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c254 expref: 18 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401397:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960856.401410:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960856.401415:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93400/0x1808d16e4c98018c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c190 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401427:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960856.401430:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786960856.401434:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93000/0x1808d16e4c9804b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c262 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401445:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9766559de900) 00010000:00010000:0.0:1786960856.401447:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960856.401451:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0e00/0x1808d16e4c97f791 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bed4 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401465:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960856.401467:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786960856.401476:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97666c6e0c00/0x1808d16e4c97fe1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c094 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401487:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff976643e01600) 00010000:00010000:0.0:1786960856.401489:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960856.401492:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93600/0x1808d16e4c97fd10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c04e expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401505:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960856.401507:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786960856.401517:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e93c00/0x1808d16e4c97f801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bef0 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401530:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9766559de100) 00010000:00010000:0.0:1786960856.401532:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786960856.401535:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c9803ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c21c expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401548:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff976661496100) 00010000:00010000:0.0:1786960856.401550:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786960856.401553:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976642e92600/0x1808d16e4c97faee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bfc2 expref: 10 pid: 8734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401565:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9766559de600) 00010000:00010000:0.0:1786960856.401568:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1786960856.401571:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976682169200/0x1808d16e4c97fead lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c0be expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960856.401591:0:5799:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff976664d29800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1786960856.401604:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960856.401606:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960856.401608:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960856.402054:0:8734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e2d64e27-0ccc-4195-8812-2a972b8bf63c+7:2340:x1873763958366080:12345-192.168.203.23@tcp:39:umount.0 Request processed in 1652us (1951us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1786960856.402065:0:8734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 240 00000100:00100000:2.0:1786960856.884610:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967780608:0@lo:400:kworker.0 00000100:00100000:2.0:1786960856.884681:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960856.884763:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960856.884769:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967780736:0@lo:400:kworker.0 00000100:00100000:2.0:1786960856.884795:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960856.884848:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780608 00000100:00100000:2.0:1786960856.884856:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780608 00000100:00100000:2.0:1786960856.884907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1786960856.884917:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967780608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960856.884961:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976677b68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967780608:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960856.884968:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1786960856.884987:0:8239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780736 00000100:00100000:2.0:1786960856.884990:0:8239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780736 00000100:00100000:2.0:1786960856.885027:0:8239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786960856.885033:0:8239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967780736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885175:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967780352:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885242:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960856.885265:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967780864:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885285:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960856.885300:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786960856.885305:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967780480:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885325:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960856.885341:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967780992:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885361:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960856.885384:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780864 00000100:00100000:1.0:1786960856.885387:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780864 00000100:00100000:1.0:1786960856.885410:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780480 00000100:00100000:1.0:1786960856.885412:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780480 00000100:00100000:1.0:1786960856.885423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786960856.885429:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967780864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885461:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1873763967780864:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960856.885467:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786960856.885477:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1786960856.885482:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667aeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967780480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885503:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667aeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967780480:12345-0@lo:400:kworker.0 Request processed in 21us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960856.885508:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1786960856.885521:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780352 00000100:00100000:1.0:1786960856.885525:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780352 00000100:00100000:1.0:1786960856.885545:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786960856.885550:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967780352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885585:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967780352:12345-0@lo:400:kworker.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960856.885591:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1786960856.885618:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967780992 00000100:00100000:1.0:1786960856.885621:0:6660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967780992 00000100:00100000:1.0:1786960856.885643:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786960856.885649:0:6660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967780992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885673:0:6660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967780992:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960856.885678:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786960856.885724:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674116a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967780480:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885734:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967780992:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885741:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967780352:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885749:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1873763967780864:0@lo:400:kworker.0 00000100:00080000:1.0:1786960856.885797:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786960856.885801:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786960856.885803:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960856.885818:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967780736:0@lo:400:kworker.0 00000100:00100000:1.0:1786960856.885828:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674114380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967780608:0@lo:400:kworker.0 00000100:00100000:2.0:1786960856.885989:0:8239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976650f02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967780736:12345-0@lo:400:kworker.0 Request processed in 955us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960856.885996:0:8239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786960856.887465:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967781120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960856.887521:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960856.887608:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781120 00000100:00100000:0.0:1786960856.887615:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781120 00000100:00100000:0.0:1786960856.887660:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786960856.887670:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967781120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960856.887712:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960856.887765:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967781120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960856.887786:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786960856.887824:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967781120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786960857.332426:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960857.396568:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967781248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960857.396637:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960857.396782:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781248 00000100:00100000:0.0:1786960857.396790:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781248 00000100:00100000:0.0:1786960857.396850:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786960857.396860:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967781248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786960857.396895:0:6662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960857.396950:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967781248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960857.396957:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786960857.397639:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967781248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960857.415904:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960857.416021:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960857.416122:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366336 00000100:00100000:0.0:1786960857.416137:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366336 00000100:00100000:0.0:1786960857.416275:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366208 00000100:00100000:0.0:1786960857.416280:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366208 00000100:00100000:0.0:1786960857.416314:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1786960857.416325:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2344:x1873763958366336:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786960857.416337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:0.0:1786960857.416342:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960857.416364:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976642e93200/0x1808d16e4c97f736 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790bebf expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960857.416382:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960857.416394:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366464 00000100:00100000:3.0:1786960857.416414:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366464 00000100:00100000:0.0:1786960857.416448:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+11:2344:x1873763958366336:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 122us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960857.416458:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1786960857.416469:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1786960857.416482:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2344:x1873763958366208:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1786960857.416491:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1786960857.416511:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+10:2342:x1873763958366464:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960857.416525:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960857.416544:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960857.416550:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044e00/0x1808d16e4c97f599 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be10 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960857.416563:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045e00/0x1808d16e4c97f5a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be3a expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960857.416572:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786960857.416577:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960857.416621:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d15850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+8:2344:x1873763958366208:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 141us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960857.416631:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1786960857.416804:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+7:2342:x1873763958366464:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 302us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960857.416813:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1786960857.424781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960857.424876:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366720 00000100:00100000:1.0:1786960857.424899:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366720 00000100:00080000:2.0:1786960857.424966:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960857.425003:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:1.0:1786960857.425035:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+6:2340:x1873763958366720:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:1.0:1786960857.425088:0:5812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f5ae 00000020:00010000:1.0:1786960857.425099:0:5812:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97667ab10800: total 0 00000100:00080000:1.0:1786960857.425104:0:5812:0:(import.c:65:import_set_state_nolock()) ffff97667ab15800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786960857.425143:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1786960857.425581:0:5799:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97667ab10800: total 0 00010000:00010000:0.0:1786960857.425643:0:5799:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97667ab10800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1786960857.425686:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:0.0:1786960857.425690:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786960857.425718:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926c00/0x1808d16e4c9804db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c270 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960857.425746:0:5799:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97667ab10800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1786960857.425758:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960857.425761:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960857.425763:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960857.426048:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d324ae8-10bd-4c51-b1d0-a2b4e29b1987+3:2340:x1873763958366720:12345-192.168.203.23@tcp:39:umount.0 Request processed in 1015us (1279us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1786960857.426058:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 241 00000100:00100000:1.0:1786960857.443636:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960857.444003:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958366976 00000100:00100000:3.0:1786960857.444018:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958366976 00000100:00100000:3.0:1786960857.444089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 306 00000100:00100000:3.0:1786960857.444101:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+7:2340:x1873763958366976:12345-192.168.203.23@tcp:251:umount.0 00000020:00000080:3.0:1786960857.444159:0:5804:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f4a4 00000020:00010000:3.0:1786960857.444168:0:5804:0:(genops.c:1942:obd_stale_export_put()) Put export ffff976664d2a800: total 0 00000100:00080000:3.0:1786960857.444174:0:5804:0:(import.c:65:import_set_state_nolock()) ffff976664d2f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1786960857.444316:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97664e606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d2a0b7eb-402f-48c4-b539-94a5ccdd0ced+3:2340:x1873763958366976:12345-192.168.203.23@tcp:251:umount.0 Request processed in 218us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960857.444325:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 306 00000020:00010000:0.0:1786960857.444566:0:5798:0:(genops.c:1928:obd_stale_export_get()) Get export ffff976664d2a800: total 0 00010000:00010000:0.0:1786960857.444572:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960857.444639:0:5798:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff976664d2a800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1786960857.444679:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6a00/0x1808d16e4c97f55a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790be02 expref: 2 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960857.444703:0:5798:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff976664d2a800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1786960857.444714:0:5798:0:(genops.c:906:class_export_put()) final put ffff976664d2a800/d2a0b7eb-402f-48c4-b539-94a5ccdd0ced 00010000:00010000:0.0:1786960857.444734:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960857.444758:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960857.444760:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786960857.444838:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976664d2a800/d2a0b7eb-402f-48c4-b539-94a5ccdd0ced for MGS 00000020:00000080:1.0:1786960857.444886:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff976664d2f000 for MGS 00010000:00010000:0.0:1786960858.356503:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960858.473908:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:1.0:1786960858.473922:0:6685:0:(genops.c:906:class_export_put()) final put ffff9766520b1800/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:0.0:1786960858.473988:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9766520b1800/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-OST0000 00000020:00000080:0.0:1786960858.474064:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9766520b3000 for lustre-OST0000 00000001:00080000:0.0:1786960858.475015:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1786960858.475087:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000001:00080000:0.0:1786960858.475094:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1786960858.475098:0:5833:0:(genops.c:906:class_export_put()) final put ffff97667ab10800/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 00000001:00100000:0.0:1786960858.475121:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000001:00080000:0.0:1786960858.475128:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1786960858.475136:0:5833:0:(genops.c:906:class_export_put()) final put ffff976664d29800/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:2.0:1786960858.475149:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ab10800/7d324ae8-10bd-4c51-b1d0-a2b4e29b1987 for lustre-MDT0000 00000020:00000080:2.0:1786960858.475221:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976664d29800/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-MDT0000 00000020:00000080:2.0:1786960858.475271:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ab15800 for lustre-MDT0000 00000020:00000080:2.0:1786960858.475279:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ab11800 for lustre-MDT0000 00000020:01000004:0.0:1786960858.864393:0:13040:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1786960858.883559:0:13040:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1786960858.883610:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.883626:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.883633:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.883641:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.883676:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786960858.883682:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786960858.883736:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786960858.883741:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786960858.883746:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786960858.883769:0:13040:0:(import.c:65:import_set_state_nolock()) ffff976673d5d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1786960858.883967:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960858.883974:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.883995:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960858.883999:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.884008:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960858.884016:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960858.884022:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786960858.884025:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786960858.884028:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786960858.884053:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.884060:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786960858.884120:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967781376:0@lo:39:umount.0 00000100:00100000:1.0:1786960858.884124:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967781504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960858.884211:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.884223:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168600/0x1808d16e4c97f529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f530 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.884250:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.884252:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.884257:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960858.888804:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960858.889003:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781376 00000100:00100000:2.0:1786960858.889018:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781376 00000100:00100000:2.0:1786960858.889090:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1786960858.889101:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1873763967781376:12345-0@lo:39:umount.0 00000020:00000080:2.0:1786960858.889169:0:5810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f2b3 00000100:00080000:2.0:1786960858.889182:0:5810:0:(import.c:65:import_set_state_nolock()) ffff97667a682800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1786960858.889298:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3284:x1873763967781376:12345-0@lo:39:umount.0 Request processed in 198us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960858.889306:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1786960858.889317:0:5810:0:(genops.c:906:class_export_put()) final put ffff97667a682000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1786960858.889347:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786960858.889360:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667a682000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1786960858.889414:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667a682800 for lustre-MDT0000 00000100:00080000:2.0:1786960858.889457:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976673d5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786960858.889472:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967781376:0@lo:39:umount.0 00000100:00100000:1.0:1786960858.891727:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960858.891795:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781504 00000100:00100000:3.0:1786960858.891809:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781504 00000100:00080000:1.0:1786960858.891828:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786960858.891833:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786960858.891841:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1786960858.891885:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960858.891898:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+19:3287:x1873763967781504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960858.891928:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960858.891956:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6c00/0x1808d16e4c97f530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f529 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.892057:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960858.892133:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3287:x1873763967781504:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960858.892141:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786960858.892247:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967781504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786960858.895291:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895311:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895319:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895326:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895351:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960858.895359:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895366:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.895373:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895386:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960858.895404:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895418:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960858.895422:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895433:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960858.895440:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960858.895446:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786960858.895449:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1786960858.895496:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895515:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786960858.895584:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1786960858.895661:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895669:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9766743a7800/0x1808d16e4c97f537 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f53e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960858.895695:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.895697:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.895699:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960858.895742:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967781632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960858.895833:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786960858.895948:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960858.895950:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781632 00000100:00100000:0.0:1786960858.895961:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781632 00010000:00010000:1.0:1786960858.895982:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960858.895993:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896000:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896006:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896012:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896035:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786960858.896041:0:13040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896047:0:13040:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896055:0:13040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896061:0:13040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960858.896088:0:13040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1786960858.896093:0:13040:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1786960858.896100:0:13040:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:0.0:1786960858.896116:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000020:01000004:1.0:1786960858.896132:0:13040:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:0.0:1786960858.896133:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3287:x1873763967781632:12345-0@lo:103:ldlm_bl.0 00000020:01000000:1.0:1786960858.896143:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1786960858.896150:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1786960858.896155:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1786960858.896158:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1786960858.896169:0:13040:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97667a86d000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786960858.896178:0:13040:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9766772e3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1786960858.896181:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1c00/0x1808d16e4c97f53e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f537 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1786960858.896221:0:13040:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff97666b7db380) has exports, disconnecting them 00000020:00080000:1.0:1786960858.896234:0:13040:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97667a86d000), last request at 1786960856 00000020:00000080:1.0:1786960858.896247:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f426 00010000:00010000:0.0:1786960858.896247:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1786960858.896273:0:13040:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1786960858.896306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ae9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c3f21e71-ba64-41c6-8589-43a20e36767f+17:3287:x1873763967781632:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960858.896318:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00080000:1.0:1786960858.896331:0:13040:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97667a86d000): rc 0 00000020:00000080:1.0:1786960858.896335:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667a86d000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1786960858.896356:0:13040:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9766772e3800), last request at 1786960856 00000020:00000080:1.0:1786960858.896361:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f35b 00000100:00080000:1.0:1786960858.896368:0:13040:0:(import.c:65:import_set_state_nolock()) ffff9766772e2800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786960858.896381:0:13040:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9766772e3800): rc 0 00000100:00100000:0.0:1786960858.896381:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967781632:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1786960858.896391:0:13040:0:(genops.c:906:class_export_put()) final put ffff9766772e3800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1786960858.896402:0:13040:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3e2c15d7ae0 00000020:00000080:0.0:1786960858.896421:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667a86d000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1786960858.896500:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9766772e3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1786960858.896536:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667a86c800 for lustre-MDT0000 00000020:00000080:0.0:1786960858.896545:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9766772e2800 for lustre-MDT0000 00010000:00010000:3.0:1786960858.896606:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786960858.896612:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896619:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168a00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960858.896622:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896630:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960858.896636:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960858.896641:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786960858.896643:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1786960858.896645:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786960858.896666:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896672:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960858.896709:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896724:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168a00/0x1808d16e4c97f45e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f465 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896752:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786960858.896756:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896762:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960858.896764:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896771:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960858.896777:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960858.896782:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786960858.896784:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786960858.896786:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786960858.896801:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896807:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960858.896814:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896820:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0200/0x1808d16e4c97f760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f767 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896842:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960858.896846:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896852:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960858.896854:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896861:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960858.896867:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960858.896872:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786960858.896875:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786960858.896877:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786960858.896893:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896899:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786960858.896909:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896915:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682169800/0x1808d16e4c97f212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f219 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.896940:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960858.896943:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960858.896954:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.896997:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960858.897042:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967781888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960858.897083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960858.897126:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786960858.897134:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967781760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960858.897140:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781888 00000100:00100000:2.0:1786960858.897151:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781888 00000100:00100000:3.0:1786960858.897159:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960858.897239:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967781760 00000100:00100000:3.0:1786960858.897245:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967781760 00000100:00100000:2.0:1786960858.897250:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786960858.897267:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3286:x1873763967781888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960858.897283:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786960858.897296:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1786960858.897305:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a400/0x1808d16e4c97f767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f760 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960858.897311:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+18:3286:x1873763967781760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960858.897333:0:6673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960858.897334:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960858.897351:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169b800/0x1808d16e4c97f465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f45e expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960858.897372:0:6673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960858.897468:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786960858.897479:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967782016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786960858.897508:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960858.897547:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1786960858.897558:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00080000:1.0:1786960858.897579:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786960858.897585:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1786960858.897603:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786960858.897673:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1786960858.897707:0:13040:0:(import.c:65:import_set_state_nolock()) ffff976677706800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1786960858.897763:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967782016 00000100:00100000:0.0:1786960858.897769:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967782016 00000100:00100000:2.0:1786960858.897774:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3286:x1873763967781888:12345-0@lo:103:ldlm_bl.0 Request processed in 510us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960858.897786:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786960858.897804:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786960858.897815:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3288:x1873763967782016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786960858.897845:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c3f21e71-ba64-41c6-8589-43a20e36767f+16:3286:x1873763967781760:12345-0@lo:103:ldlm_bl.0 Request processed in 540us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960858.897850:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1786960858.897892:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960858.897900:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1600/0x1808d16e4c97f219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f212 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960858.897910:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960858.897938:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c3f21e71-ba64-41c6-8589-43a20e36767f+14:3288:x1873763967782016:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960858.897950:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786960858.897981:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967782016:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1786960858.898383:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786960858.898420:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1786960858.898437:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786960858.898497:0:13040:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1786960858.898512:0:13040:0:(import.c:65:import_set_state_nolock()) ffff97667ab15000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1786960858.898542:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97666b7db380) has no exports 00000100:00100000:2.0:1786960858.909126:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97664e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967781760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960858.909148:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3f21e71-ba64-41c6-8589-43a20e36767f:3286:1873763967781888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960858.909344:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967782144:0@lo:9:umount.0 00000100:00100000:2.0:1786960858.909429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960858.909467:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967782272:0@lo:9:umount.0 00000100:00100000:2.0:1786960858.909491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960858.909527:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967782144 00000100:00100000:2.0:1786960858.909533:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967782144 00000100:00100000:2.0:1786960858.909574:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967782272 00000100:00100000:2.0:1786960858.909576:0:6658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967782272 00000100:00100000:2.0:1786960858.909593:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786960858.909601:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1873763967782144:12345-0@lo:9:umount.0 00000020:00000080:2.0:1786960858.909625:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f3a8 00000100:00080000:2.0:1786960858.909632:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667a86b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786960858.909666:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1786960858.909961:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3284:x1873763967782144:12345-0@lo:9:umount.0 Request processed in 359us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960858.909968:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786960858.909992:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1786960858.909998:0:6658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1873763967782272:12345-0@lo:9:umount.0 00000020:00000080:2.0:1786960858.910009:0:6658:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f48f 00000100:00080000:2.0:1786960858.910013:0:6658:0:(import.c:65:import_set_state_nolock()) ffff97667ac8b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786960858.910030:0:6658:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1786960858.911150:0:6658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3284:x1873763967782272:12345-0@lo:9:umount.0 Request processed in 975us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960858.911161:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1786960858.911216:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960858.911220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786960858.911308:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960858.911323:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786960858.911350:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976677706800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786960858.911376:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786960858.911378:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786960858.911383:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967782144:0@lo:9:umount.0 00000100:00080000:2.0:1786960858.911397:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667ab15000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1786960858.911406:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1786960858.911407:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1786960858.911410:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967782272:0@lo:9:umount.0 00000020:00080000:1.0:1786960858.919370:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97666b7db380) has no exports 00000020:00000080:1.0:1786960858.970007:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f26d 00000020:00000080:1.0:1786960858.970024:0:13040:0:(genops.c:906:class_export_put()) final put ffff9766739fe800/lustre-QMT0000_UUID 00000020:01000000:1.0:1786960858.970045:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1786960858.970136:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960858.970149:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786960858.970154:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff97664e5cb380) has no exports 00000020:00000080:2.0:1786960858.971089:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9766739fe800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1786960858.975675:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f266 00000020:00000080:0.0:1786960858.975699:0:13040:0:(genops.c:906:class_export_put()) final put ffff9766752b1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786960858.975770:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960858.975780:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786960858.975783:0:13040:0:(genops.c:906:class_export_put()) final put ffff9766752b3800/lustre-QMT0000_UUID 00000020:00000080:0.0:1786960858.975786:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff9766752b3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1786960858.975795:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1786960858.976027:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9766752b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1786960858.976154:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff976673ec8240 - data ffff976677e93000/ffff9766771fb000 00000020:01000000:0.0:1786960858.976320:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff976647bbc540 - data ffff97666edb6798/ffff97667a6c6800 00000001:00000004:0.0:1786960858.990348:0:13040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1786960859.112481:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786960859.112490:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1786960859.112515:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786960859.112518:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786960859.118636:0:7102:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786960859.118644:0:7102:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1786960859.118662:0:7102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1786960859.120262:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786960859.120268:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1786960859.120281:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786960859.120284:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1786960859.120551:0:8063:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1786960859.120556:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1786960859.120567:0:8063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1786960859.173308:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f235 00000020:00000080:0.0:1786960859.173321:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667b204000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786960859.174648:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f24a 00000020:00000080:0.0:1786960859.174660:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667b206000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786960859.174718:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b204000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1786960859.174787:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1786960859.174795:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960859.174804:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786960859.174808:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97666b7d99c0) has no exports 00000004:01000000:0.0:1786960859.174973:0:13040:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1786960859.174982:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f488 00000020:00000080:0.0:1786960859.174986:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667ab10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786960859.175121:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b206000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1786960859.175213:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786960859.175233:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960859.175254:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786960859.175258:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff97664e468000) has no exports 00000020:00000080:0.0:1786960859.175264:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f481 00000020:00000080:0.0:1786960859.175269:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667ab13800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786960859.175427:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ab10000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1786960859.175963:0:13040:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1786960859.175967:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786960859.175971:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1786960859.175976:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786960859.175991:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786960859.176158:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ab13800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786960859.176330:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960859.176340:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786960859.176345:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f3a1 00000020:00000080:0.0:1786960859.176350:0:13040:0:(genops.c:906:class_export_put()) final put ffff97664e57e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786960859.176368:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ab15000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1786960859.176374:0:37:0:(genops.c:906:class_export_put()) final put ffff97667b0b8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786960859.176376:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b0b8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1786960859.176381:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786960859.176498:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786960859.176504:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786960859.176553:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97664e57e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1786960859.176581:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786960859.176586:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97664e7f0000) has no exports 00000020:00000080:0.0:1786960859.176594:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f39a 00000020:00000080:0.0:1786960859.176599:0:13040:0:(genops.c:906:class_export_put()) final put ffff976677707800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1786960859.177396:0:13040:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1786960859.177401:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786960859.177405:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1786960859.177415:0:13040:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786960859.177417:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786960859.177465:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976677707800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786960859.177554:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960859.177563:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786960859.177596:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960859.177601:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786960859.177606:0:13040:0:(genops.c:906:class_export_put()) final put ffff9766782f3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786960859.177609:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff9766782f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1786960859.177618:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786960859.177803:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f251 00000020:00000080:0.0:1786960859.177809:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667b202000/lustre-MDD0000_UUID 00000020:00000080:2.0:1786960859.177832:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff976677706800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1786960859.177837:0:37:0:(genops.c:906:class_export_put()) final put ffff976673d5c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786960859.177840:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976673d5c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1786960859.177853:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786960859.178111:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1786960859.178117:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960859.178127:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786960859.178131:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff97666b7dcd40) has no exports 00000020:00000080:0.0:1786960859.178218:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960859.178222:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1786960859.178232:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f258 00000020:00000080:0.0:1786960859.178241:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667b200000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786960859.178335:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b202000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1786960859.178340:0:37:0:(genops.c:906:class_export_put()) final put ffff97667b206800/lustre-MDD0000_UUID 00000020:00000080:2.0:1786960859.178342:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b206800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1786960859.178346:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1786960859.178551:0:13040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff976652341800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1786960859.178557:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff976652341800 3 00000020:01000004:0.0:1786960859.178560:0:13040:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff976652341800 from lustre-MDT0000 00000020:00000080:0.0:1786960859.178583:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960859.178588:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1786960859.178590:0:13040:0:(genops.c:906:class_export_put()) final put ffff97667b201000/lustre-MDT0000_UUID 00000020:00000080:0.0:1786960859.178593:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b201000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1786960859.178601:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1786960859.178630:0:13040:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1786960859.178634:0:13040:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1786960859.178638:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1786960859.178641:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960859.178644:0:13040:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786960859.178651:0:13040:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97664e4d2000 c3f21e71-ba64-41c6-8589-43a20e36767f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786960859.178658:0:13040:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff97664e4699c0) has exports, disconnecting them 00000020:00080000:0.0:1786960859.178662:0:13040:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97664e4d2000), last request at 1786960627 00000020:00000080:0.0:1786960859.178679:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f1f6 00000020:00010000:0.0:1786960859.178693:0:13040:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97664e4d2000: total 1 00000100:00080000:0.0:1786960859.178698:0:13040:0:(import.c:65:import_set_state_nolock()) ffff97664e4d6000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786960859.178746:0:13040:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97664e4d2000): rc 0 00000020:00080000:0.0:1786960859.178750:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff97664e4699c0) has no exports 00000100:00100000:0.0:1786960859.178809:0:5804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97664e77ec00:5804] 1 exiting: rc = 0 00000020:00010000:3.0:1786960859.179003:0:5799:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97664e4d2000: total 1 00010000:00010000:3.0:1786960859.179108:0:5799:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97664e4d2000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1786960859.179136:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045c00/0x1808d16e4c97f522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f51b expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179152:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a7600/0x1808d16e4c97f54c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f545 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179164:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1a00/0x1808d16e4c97f74b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f744 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179211:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a800/0x1808d16e4c97f759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f752 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179228:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169600/0x1808d16e4c97f30e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f307 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179249:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682169400/0x1808d16e4c97f4f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f4f1 expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179260:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6000/0x1808d16e4c97f506 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f4ff expref: 3 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179271:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97666c6e1200/0x1808d16e4c97f514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1808d16e4c97f50d expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960859.179282:0:5799:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97664e4d2000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1786960859.179297:0:5799:0:(genops.c:906:class_export_put()) final put ffff97664e4d2000/c3f21e71-ba64-41c6-8589-43a20e36767f 00000100:00100000:0.0:1786960859.179369:0:5805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97666b7cac00:5805] 2 exiting: rc = 0 00000020:00000080:2.0:1786960859.179461:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b200000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1786960859.179517:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960859.179520:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960859.179521:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786960859.179542:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97664e4d2000/c3f21e71-ba64-41c6-8589-43a20e36767f for MGS 00000020:00000080:2.0:1786960859.179626:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97664e4d6000 for MGS 00000100:00100000:1.0:1786960859.184082:0:5803:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97664e77fc00:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1786960859.188034:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188046:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188054:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188060:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188066:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188072:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188077:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188084:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188104:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188111:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188117:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188122:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188129:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188134:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188141:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188151:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188157:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188162:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188168:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188172:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188178:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188183:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188220:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188226:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188231:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188236:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188241:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188247:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188252:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188258:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188263:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188268:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188274:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188281:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188287:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188292:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188297:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188302:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188307:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188312:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188317:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188322:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.188328:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189231:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189238:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189243:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189252:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189260:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189266:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189272:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189277:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189282:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189288:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189293:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189298:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189303:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189308:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189313:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189319:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189326:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189341:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189348:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189354:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.189360:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1786960859.189903:0:13040:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786960859.189907:0:13040:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1786960859.192754:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97664a2ec480 - data ffff976677d66000/ffff97667ae0bc00 00000020:01000000:3.0:1786960859.192884:0:13040:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97666b6b7a20 - data ffff97666efa4510/ffff97664e5f0800 00000020:00000080:3.0:1786960859.193460:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f1da 00000020:00000080:3.0:1786960859.193467:0:13040:0:(genops.c:906:class_export_put()) final put ffff976652347000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1786960859.193490:0:13040:0:(tgt_mount.c:187:server_put_mount()) put mount ffff976652341800 from MGS, refs=2 00000020:01000004:3.0:1786960859.193494:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff976652341800 2 00000020:01000004:3.0:1786960859.193497:0:13040:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff976652341800 from MGS 00000020:00000080:3.0:1786960859.193516:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786960859.193534:0:13040:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1786960859.193537:0:13040:0:(genops.c:906:class_export_put()) final put ffff976652b54800/MGS 00000020:00000080:3.0:1786960859.193540:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff976652b54800/MGS for MGS 00000020:01000000:3.0:1786960859.193547:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1786960859.193603:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1786960859.193606:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786960859.193611:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786960859.193617:0:13040:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff976673d5a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786960859.193623:0:13040:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff97667a6ecd40) has exports, disconnecting them 00000020:00080000:3.0:1786960859.193627:0:13040:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff976673d5a000), last request at 1786960628 00000020:00000080:3.0:1786960859.193632:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f2a5 00000020:00080000:3.0:1786960859.193640:0:13040:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff976673d5a000): rc 0 00000020:00000080:3.0:1786960859.193644:0:13040:0:(genops.c:906:class_export_put()) final put ffff976673d5a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786960859.193716:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976652347000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786960859.193737:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976673d5a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1786960859.201567:0:13040:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1786960859.201576:0:13040:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786960859.201581:0:13040:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786960859.201589:0:13040:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1786960859.201826:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786960859.201836:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1786960859.201843:0:13040:0:(obd_mount.c:710:lustre_put_lsi()) put ffff976652341800 1 00000020:00000080:2.0:1786960859.201850:0:13040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f1cc 00000020:00000080:2.0:1786960859.201859:0:13040:0:(genops.c:906:class_export_put()) final put ffff976652b56800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786960859.203200:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff976673d5d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1786960859.203216:0:37:0:(genops.c:906:class_export_put()) final put ffff976643943000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1786960859.203219:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976643943000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1786960859.203232:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1786960859.204956:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1786960859.204970:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786960859.204977:0:13040:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786960859.204983:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff97666b7d8000) has no exports 00000020:00000080:0.0:1786960859.207518:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff976652b56800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1786960859.231702:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786960859.231717:0:13040:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1786960859.231723:0:13040:0:(genops.c:906:class_export_put()) final put ffff976652341000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1786960859.231728:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff976652341000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1786960859.231738:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1786960859.231865:0:13040:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff976652344000 00000020:01000000:2.0:1786960859.231890:0:13040:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1786960859.231894:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786960859.231898:0:13040:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786960859.231935:0:13040:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97664e5c99c0) has no exports 00000100:00100000:2.0:1786960859.232092:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97664e5d1600:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1786960859.232224:0:5810:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff976651b35a00:5810] 0 exiting: rc = 1 00000100:00100000:1.0:1786960859.236011:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff976652252c00:5812] 2 exiting: rc = 0 00000100:00100000:3.0:1786960859.236130:0:8734:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97666b661000:8734] 3 exiting: rc = 0 00000100:00100000:2.0:1786960859.236407:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236415:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236423:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236439:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236446:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236452:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236459:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236464:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236470:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236475:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236481:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236486:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236492:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236497:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236502:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236508:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236512:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236518:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236524:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236529:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236545:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236555:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236560:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236567:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236579:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236591:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236597:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236603:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236609:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236615:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236620:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236625:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236642:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236647:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236653:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236658:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236665:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236670:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236676:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236689:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236695:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236701:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236705:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236711:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236716:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236722:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236727:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236732:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236738:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236744:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236749:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236755:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236760:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236765:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236770:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236775:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236780:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236789:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236794:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236799:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236805:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236810:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236816:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.236835:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.252543:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff976648c7ba00:5814] 1 exiting: rc = 0 00000100:00100000:2.0:1786960859.255118:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff976648ef4600:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1786960859.255253:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255261:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255267:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255290:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255297:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255303:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255314:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255322:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255327:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255333:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255339:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255345:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255352:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255357:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255362:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255367:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255372:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255377:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255383:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255388:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255393:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255399:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255404:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255410:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255415:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255481:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255490:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255495:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255500:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255505:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255510:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255516:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255521:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255527:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255532:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255538:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255543:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255548:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255562:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255568:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255573:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255578:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255584:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255589:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255594:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255599:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255604:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255609:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255615:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255620:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255624:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255629:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255633:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255639:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255644:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255649:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255655:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255660:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255666:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255687:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255695:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255700:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255707:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.255712:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.256383:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97666b7cb400:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1786960859.257333:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff976648c7b800:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1786960859.257412:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257420:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257425:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257431:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257437:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257442:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257447:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257453:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257472:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257477:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257483:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257489:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257773:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257781:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257787:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257792:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257798:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257804:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257810:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257816:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257821:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257826:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257832:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257838:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257857:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257863:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257870:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257876:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257882:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257888:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257893:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257899:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.257906:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258545:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258561:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258902:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258940:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258949:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258955:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258964:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258970:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258976:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258982:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.258998:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259004:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259010:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259025:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259032:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259056:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259062:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259068:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259073:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259078:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259085:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259091:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259097:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259104:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259109:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259115:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259120:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259141:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259149:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259155:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.259161:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960859.286169:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff976648c18c00:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1786960859.288689:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff976648c19000:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1786960859.288835:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288842:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288847:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288852:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288856:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288861:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288866:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288870:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288875:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288879:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288884:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288889:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288894:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288901:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288934:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288941:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288948:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288955:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288962:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288971:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288979:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288988:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.288999:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289009:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289033:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289039:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289044:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289049:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289054:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289059:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289066:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289079:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289085:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289090:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289095:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289101:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289108:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289118:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289123:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289129:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289134:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289139:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289145:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289150:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289155:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289160:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289166:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289171:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289176:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289219:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289225:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289230:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289235:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289242:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289248:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289258:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289267:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289272:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289279:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289284:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289289:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289298:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289304:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.289309:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786960859.289929:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff976648c19800:5820] 1 exiting: rc = 0 00000100:00100000:2.0:1786960859.290115:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff976648c19a00:5819] 0 exiting: rc = 1 00000100:00100000:0.0:1786960859.296728:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296738:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296743:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296749:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296755:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296761:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296766:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296771:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296777:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296782:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296788:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296793:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296797:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296802:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296807:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296812:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296817:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296821:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296827:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296831:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296852:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296859:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296866:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296873:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296880:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296888:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296894:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.296901:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297421:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297435:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297442:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297448:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297454:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297461:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297468:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297475:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297482:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297488:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297494:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297501:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297507:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297513:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297520:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297525:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297531:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297537:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297545:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297552:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297558:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297564:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297572:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297577:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297584:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297592:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297604:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297619:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297629:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297635:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297641:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297646:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297652:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297657:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297662:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.297668:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786960859.300395:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff976648c18a00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1786960859.300583:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff976648c6f600:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1786960859.301000:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301008:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301081:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301089:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301095:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301100:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301105:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301110:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301115:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301119:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301124:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301129:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301134:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301139:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301144:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301149:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301153:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301158:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301164:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301168:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301173:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301177:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301182:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301204:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301210:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301215:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301238:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301246:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301254:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301262:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301270:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301277:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301282:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301287:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301293:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301298:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301305:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301311:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301318:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301325:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301331:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301335:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301341:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301345:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301350:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301356:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301360:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301365:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301370:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301374:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301380:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301385:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301389:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301394:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301400:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301405:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301411:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301416:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301421:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301426:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301431:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301447:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301453:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.301460:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786960859.302045:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff976648c18600:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1786960859.302933:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97667a690c00:5825] 2 exiting: rc = 0 00000100:00100000:2.0:1786960859.303660:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff976648c18200:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1786960859.304129:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304140:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304146:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304152:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304157:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304163:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304168:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304175:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304180:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304431:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304440:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304446:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304453:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304460:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304469:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304476:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304484:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304492:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304500:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304508:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304516:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304524:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304533:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304605:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304622:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304632:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304638:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304644:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304649:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304654:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304665:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304671:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304702:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304708:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304713:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304719:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304724:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304729:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304735:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304741:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304747:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304752:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304757:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304763:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304767:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304773:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304779:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304797:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304803:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304809:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304814:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304819:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304825:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304831:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304838:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304844:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304850:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304855:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304861:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304866:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304871:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304877:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304884:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960859.304889:0:13040:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786960859.323170:0:13040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786960859.323182:0:13040:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1786960859.323209:0:13040:0:(genops.c:906:class_export_put()) final put ffff976643940800/MDS_uuid 00000020:00000080:2.0:1786960859.323213:0:13040:0:(genops.c:865:class_export_destroy()) destroying export ffff976643940800/MDS_uuid for MDS 00000020:01000000:2.0:1786960859.323223:0:13040:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1786960859.323347:0:13040:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1786960859.386462:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960860.405694:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786960861.024028:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786960861.024036:0:7615:0:(genops.c:906:class_export_put()) final put ffff97667ac8c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786960861.024139:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ac8c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:3.0:1786960861.024341:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:3.0:1786960861.024345:0:7615:0:(genops.c:906:class_export_put()) final put ffff9766818d6800/e2d64e27-0ccc-4195-8812-2a972b8bf63c 00000020:00000080:1.0:1786960861.024469:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667ac8b000 for lustre-OST0001 00000020:00000080:1.0:1786960861.024560:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9766818d6800/e2d64e27-0ccc-4195-8812-2a972b8bf63c for lustre-OST0001 00000020:00000080:1.0:1786960861.024652:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9766818d7800 for lustre-OST0001 00010000:00010000:3.0:1786960861.429231:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960862.011067:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967782400:0@lo:400:kworker.0 00000400:00000100:3.0:1786960862.011130:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873763967782400 offset 0 length 224: 4 00000100:00100000:1.0:1786960862.012032:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967782656:0@lo:400:kworker.0 00000400:00000100:1.0:1786960862.012065:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967782656 offset 0 length 224: 4 00000100:00100000:1.0:1786960862.012091:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786960862.012096:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967782528:0@lo:400:kworker.0 00000400:00000100:1.0:1786960862.012980:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967782528 offset 0 length 224: 4 00000020:01000004:3.0:1786960862.354888:0:13205:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1786960862.365326:0:13205:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1786960862.365375:0:13205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960862.365407:0:13205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960862.365414:0:13205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960862.365420:0:13205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960862.365437:0:13205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786960862.365442:0:13205:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1786960862.365468:0:13205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786960862.365479:0:13205:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766779d9c00 x1873763967782528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960862.365495:0:13205:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1786960862.365524:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1873763967782528:0@lo:400:kworker.0 00000100:00080000:3.0:1786960862.365551:0:13205:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786960862.365575:0:13205:0:(import.c:65:import_set_state_nolock()) ffff97667a86f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786960862.367265:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967782784:0@lo:39:umount.0 00000400:00000100:3.0:1786960862.367319:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967782784 offset 0 length 224: 4 00010000:00010000:1.0:1786960862.369275:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960862.369288:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960862.369301:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960862.369305:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960862.369334:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960862.369342:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960862.369348:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786960862.369351:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786960862.369354:0:5799:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786960862.369392:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960862.369399:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786960862.369457:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967782912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960862.369517:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786960862.369577:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960862.369585:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9766743a7200/0x1808d16e4c97f50d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1808d16e4c97f514 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960862.369598:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960862.369601:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960862.369602:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960862.370840:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967782912 00000100:00100000:2.0:1786960862.370849:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967782912 00000100:00100000:2.0:1786960862.370929:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786960862.370937:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976648d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3287:x1873763967782912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1786960862.371011:0:5795:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786960862 with bad export cookie 1731864328385589750 00000100:00100000:3.0:1786960862.379140:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976648d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3287:x1873763967782912:12345-0@lo:103:ldlm_bl.0 Request processed in 8195us (9615us total) trans 0 rc -107/-107 00000100:00100000:3.0:1786960862.379151:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1786960862.379393:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1786960862.379407:0:3287:0:(import.c:65:import_set_state_nolock()) ffff976643941800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1786960862.379411:0:3287:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1786960862.386488:0:3287:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.123@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1786960862.386496:0:3287:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1786960862.386505:0:3287:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766779d9500 x1873763967782400/t0(0) o400->MGC192.168.203.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786960878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960862.386534:0:3287:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766779d8380 x1873763967782912/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786960878 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1786960862.386544:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1786960862.386564:0:3287:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1786960862.386565:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1786960862.386569:0:3287:0:(import.c:65:import_set_state_nolock()) ffff976643941800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786960862.386574:0:3287:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 109 00000100:00080000:2.0:1786960862.386582:0:3287:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff976643941800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960862.386673:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c3f21e71-ba64-41c6-8589-43a20e36767f:3288:1873763967782400:0@lo:400:kworker.0 00000100:00100000:3.0:1786960862.386734:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace5c00 x1873763967783040/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786960862.386776:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c3f21e71-ba64-41c6-8589-43a20e36767f:3287:1873763967782912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960862.387036:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967783040:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1786960862.387081:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873763967783040 offset 0 length 520: 4 00010000:00010000:3.0:1786960862.452528:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960863.476917:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786960863.639278:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786960863.639288:0:6685:0:(genops.c:906:class_export_put()) final put ffff97667a86b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786960863.639368:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667a86b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1786960863.639416:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667a86b800 for lustre-OST0000 00010000:00010000:3.0:1786960864.500363:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960865.525679:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960866.548540:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786960867.125305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786960867.125316:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786960867.125510:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967783168:0@lo:400:kworker.0 00000400:00000100:3.0:1786960867.125561:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967783168 offset 0 length 224: 4 00010000:00010000:1.0:1786960867.572477:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960868.597526:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960869.620433:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960870.644422:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960871.669645:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786960872.244423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786960872.244457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786960872.244580:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967783296:0@lo:400:kworker.0 00000400:00000100:3.0:1786960872.244676:0:3285:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967783296 offset 0 length 224: 4 00010000:00010000:3.0:1786960872.695759:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960872.756323:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960862/real 1786960862] req@ffff97667ace5c00 x1873763967783040/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786960872 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960872.756373:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97667ace5c00 x1873763967783040/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786960872 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960872.756385:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960862/real 1786960862] req@ffff97667ace7100 x1873763967782784/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786960872 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960872.756400:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97667ace7100 x1873763967782784/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786960872 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786960872.756422:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976643941800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786960872.756505:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1786960872.756510:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967783040:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1786960872.756519:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a86f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786960872.756539:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967782784:0@lo:39:umount.0 00000100:00080000:1.0:1786960872.756636:0:13205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786960872.756642:0:13205:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786960872.756648:0:13205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1786960872.757616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786960872.757626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1786960872.757630:0:37:0:(import.c:65:import_set_state_nolock()) ffff976643941800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786960872.757637:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 344 00000100:00080000:3.0:1786960872.757644:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786960872.757652:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff976643941800 using connection 192.168.203.123@tcp/0@lo 00010000:00010000:1.0:1786960872.757680:0:13205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960872.757690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace6300 x1873763967783424/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1786960872.757699:0:13205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757710:0:13205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757719:0:13205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757752:0:13205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960872.757761:0:13205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757768:0:13205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757774:0:13205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757780:0:13205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960872.757798:0:13205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1786960872.757820:0:13205:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1786960872.757849:0:13205:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1786960872.757854:0:13205:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1786960872.757859:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786960872.757865:0:13205:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1786960872.757871:0:13205:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97664e5ccd40) has no exports 00010000:00010000:3.0:1786960872.757888:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786960872.757897:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.757907:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960872.757912:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.757929:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960872.757937:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960872.757943:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786960872.757946:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1786960872.757949:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1786960872.757963:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:3.0:1786960872.758171:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758181:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682168800/0x1808d16e4c97f51b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f522 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758220:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960872.758224:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758230:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e200 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:3.0:1786960872.758233:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758240:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786960872.758246:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960872.758264:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786960872.758267:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786960872.758269:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786960872.758276:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:3.0:1786960872.758279:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758285:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5e200/0x1808d16e4c97f752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f759 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960872.758297:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960872.758298:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960872.758300:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960872.758667:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967783424:0@lo:250:kworker.0 00010000:00010000:2.0:1786960872.758708:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1786960872.758745:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873763967783424 offset 0 length 520: 4 00000020:00080000:1.0:1786960872.759736:0:13205:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97664e5ccd40) has no exports 00000020:01000000:1.0:1786960872.761510:0:13205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9766523d74e0 - data ffff976677e59000/ffff97667ae43c00 00000020:01000000:1.0:1786960872.765686:0:13205:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97664a219b40 - data ffff97666efaf1b0/ffff9766752f1000 00100000:10000000:1.0:1786960872.775106:0:13205:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1786960872.846176:0:13205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f32a 00000020:00000080:1.0:1786960872.846216:0:13205:0:(genops.c:906:class_export_put()) final put ffff9766772e1000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1786960872.846246:0:13205:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97667ad21800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1786960872.846249:0:13205:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97667ad21800 2 00000020:01000004:1.0:1786960872.846253:0:13205:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97667ad21800 from lustre-OST0000 00000020:00000080:3.0:1786960872.846281:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9766772e1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1786960872.846303:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786960872.846319:0:13205:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1786960872.846322:0:13205:0:(genops.c:906:class_export_put()) final put ffff9766772e1800/lustre-OST0000_UUID 00000020:00000080:1.0:1786960872.846324:0:13205:0:(genops.c:865:class_export_destroy()) destroying export ffff9766772e1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1786960872.846336:0:13205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1786960872.846433:0:13205:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1786960872.846602:0:13205:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1786960872.846612:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786960872.846619:0:13205:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1786960872.846629:0:13205:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97667a86e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786960872.846636:0:13205:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff97664e46b380) has exports, disconnecting them 00000020:00080000:1.0:1786960872.846643:0:13205:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97667a86e800), last request at 1786960643 00000020:00000080:1.0:1786960872.846801:0:13205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f354 00000020:00080000:1.0:1786960872.846816:0:13205:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97667a86e800): rc 0 00000020:00000080:1.0:1786960872.846821:0:13205:0:(genops.c:906:class_export_put()) final put ffff97667a86e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1786960872.846901:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667a86e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1786960872.850695:0:13205:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1786960872.850707:0:13205:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786960872.850713:0:13205:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1786960872.850722:0:13205:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786960872.851458:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960872.851475:0:13205:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1786960872.851484:0:13205:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97667ad21800 1 00000020:00000080:0.0:1786960872.851507:0:13205:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f2e4 00000020:00000080:0.0:1786960872.851517:0:13205:0:(genops.c:906:class_export_put()) final put ffff97664e57e000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1786960872.852111:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667a86f800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1786960872.852122:0:37:0:(genops.c:906:class_export_put()) final put ffff97667d7df000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1786960872.852125:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97667d7df000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1786960872.852134:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1786960872.852600:0:13205:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1786960872.852608:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960872.852615:0:13205:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786960872.852621:0:13205:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff97667a6e8000) has no exports 00000020:00000080:3.0:1786960872.852685:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97664e57e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1786960872.885335:0:13205:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786960872.885354:0:13205:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1786960872.885360:0:13205:0:(genops.c:906:class_export_put()) final put ffff97667ad24800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1786960872.885365:0:13205:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ad24800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1786960872.885373:0:13205:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1786960872.885527:0:13205:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97667ad27800 00000020:02000400:3.0:1786960872.885585:0:13205:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1786960873.716841:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960874.742613:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786960875.406646:0:13361:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1786960875.425393:0:13361:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1786960875.425473:0:13361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960875.425487:0:13361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960875.425494:0:13361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960875.425502:0:13361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960875.425524:0:13361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786960875.425530:0:13361:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1786960875.425551:0:13361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786960875.425562:0:13361:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766779da300 x1873763967782656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960878 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960875.425592:0:13361:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766816c8a80 x1873763967783168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960883 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960875.425613:0:13361:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff9766779dad80 x1873763967783296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960875.425627:0:13361:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1786960875.425651:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967783296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960875.425654:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967783168:0@lo:400:kworker.0 00000100:00080000:0.0:1786960875.425695:0:13361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786960875.425717:0:13361:0:(import.c:65:import_set_state_nolock()) ffff97667a685800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786960875.425745:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967782656:0@lo:400:kworker.0 00000100:00100000:0.0:1786960875.425750:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967783552:0@lo:39:umount.0 00010000:00010000:1.0:1786960875.425860:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960875.425866:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960875.425875:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7400 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960875.425879:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960875.425888:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960875.425895:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960875.425901:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786960875.425904:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786960875.425906:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786960875.425919:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:1.0:1786960875.425922:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960875.425929:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9766743a7400/0x1808d16e4c97f4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f4f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960875.425939:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960875.425941:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960875.425942:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1786960875.426033:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873763967783552 offset 0 length 224: 4 00010000:00010000:2.0:1786960875.765097:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960876.788517:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960877.812393:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786960877.876971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786960877.876987:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1786960878.838108:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960879.860389:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960880.884599:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960881.908560:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960882.932709:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786960882.996451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1786960882.996465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c3f21e71-ba64-41c6-8589-43a20e36767f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1786960883.956383:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960884.981481:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960885.620372:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960875/real 1786960875] req@ffff9766816cb800 x1873763967783552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786960885 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960885.620415:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766816cb800 x1873763967783552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786960885 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786960885.620809:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a685800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786960885.620948:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967783552:0@lo:39:umount.0 00000100:00080000:3.0:1786960885.621028:0:13361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786960885.621034:0:13361:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786960885.621041:0:13361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786960885.622376:0:13361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622403:0:13361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622411:0:13361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622419:0:13361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622726:0:13361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960885.622738:0:13361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622747:0:13361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622755:0:13361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960885.622761:0:13361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626058:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786960885.626078:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626094:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97666c6e0400 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960885.626099:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626113:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960885.626122:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960885.626154:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786960885.626158:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1786960885.626177:0:5799:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:2.0:1786960885.626181:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626204:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e0400/0x1808d16e4c97f4ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f506 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626230:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960885.626234:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626241:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5f800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960885.626244:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626251:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960885.626258:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960885.626264:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1786960885.626266:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1786960885.626270:0:5799:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:2.0:1786960885.626273:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960885.626292:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960885.626294:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960885.626296:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960885.626377:0:13361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786960885.626387:0:13361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5f800/0x1808d16e4c97f744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f74b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960885.626412:0:13361:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1786960885.626420:0:13361:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1786960885.626423:0:13361:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1786960885.626547:0:13361:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1786960885.626617:0:13361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1786960885.626625:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786960885.626634:0:13361:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1786960885.626640:0:13361:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97664e7f19c0) has no exports 00000020:00080000:3.0:1786960885.626742:0:13361:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97664e7f19c0) has no exports 00010000:00010000:1.0:1786960885.627149:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1786960885.630316:0:13361:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9766523d72a0 - data ffff976677e59a20/ffff97667ae40c00 00000020:01000000:3.0:1786960885.630950:0:13361:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff976673ede720 - data ffff97665d2e9948/ffff97667ae40800 00100000:10000000:3.0:1786960885.644995:0:13361:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1786960885.680796:0:13361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f3f5 00000020:00000080:0.0:1786960885.680811:0:13361:0:(genops.c:906:class_export_put()) final put ffff9766772e0000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1786960885.680834:0:13361:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9766772e6000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1786960885.680839:0:13361:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766772e6000 2 00000020:01000004:0.0:1786960885.680843:0:13361:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9766772e6000 from lustre-OST0001 00000020:00000080:0.0:1786960885.680872:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960885.680886:0:13361:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1786960885.680889:0:13361:0:(genops.c:906:class_export_put()) final put ffff976642e1f800/lustre-OST0001_UUID 00000020:00000080:0.0:1786960885.680892:0:13361:0:(genops.c:865:class_export_destroy()) destroying export ffff976642e1f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1786960885.680905:0:13361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1786960885.681035:0:13361:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c3f21e71-ba64-41c6-8589-43a20e36767f->MGS 00010000:00010000:0.0:1786960885.681053:0:13361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960885.681084:0:13361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960885.681091:0:13361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1786960885.681094:0:13361:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1786960885.681097:0:13361:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1786960885.681118:0:13361:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:0.0:1786960885.681122:0:13361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97664169ae00/0x1808d16e4c97f307 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f30e expref: -99 pid: 6655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960885.681138:0:13361:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786960885.681145:0:13361:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960885.681150:0:13361:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786960885.681152:0:13361:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1786960885.681153:0:13361:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1786960885.681163:0:13361:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff976643941800 00010000:00010000:0.0:1786960885.681165:0:13361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97666c6e1e00/0x1808d16e4c97f545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1808d16e4c97f54c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786960885.681217:0:13361:0:(import.c:65:import_set_state_nolock()) ffff976643941800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1786960885.681223:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786960885.681227:0:13361:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786960885.681228:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786960885.681233:0:13361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786960885.681249:0:13361:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff97667ace6300 x1873763967783424/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1786960887 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786960885.681282:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786960885.681286:0:13361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:1.0:1786960885.681360:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9766772e0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1786960885.682441:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c3f21e71-ba64-41c6-8589-43a20e36767f:3284:1873763967783424:0@lo:250:kworker.0 10000000:01000000:0.0:1786960885.682520:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786960885.682534:0:13361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f1e8 00000020:00000080:0.0:1786960885.682546:0:13361:0:(genops.c:906:class_export_put()) final put ffff976643942000/c3f21e71-ba64-41c6-8589-43a20e36767f 00000020:01000000:0.0:1786960885.682567:0:13361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.123@tcp (flags='') 00000020:00000080:0.0:1786960885.682577:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960885.682589:0:13361:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786960885.682594:0:13361:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff97664e5c8000) has no exports 10000000:01000000:2.0:1786960885.682669:0:5807:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1786960885.682780:0:13361:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.123@tcp: client import never connected 00000100:00080000:0.0:1786960885.682784:0:13361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1786960885.682788:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1786960885.682791:0:13361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1786960885.682792:0:13361:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1786960885.682832:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786960885.682839:0:13361:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.123@tcp (uuid c3f21e71-ba64-41c6-8589-43a20e36767f) 00000020:01000000:0.0:1786960885.682846:0:13361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1786960885.682849:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786960885.682854:0:13361:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786960885.682859:0:13361:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97667b0be000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786960885.682865:0:13361:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff97664e46cd40) has exports, disconnecting them 00000020:00080000:0.0:1786960885.682870:0:13361:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97667b0be000), last request at 1786960662 00000020:00000080:0.0:1786960885.682875:0:13361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f41f 00000020:00080000:0.0:1786960885.682890:0:13361:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97667b0be000): rc 0 00000020:00000080:0.0:1786960885.682895:0:13361:0:(genops.c:906:class_export_put()) final put ffff97667b0be000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1786960885.683309:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff976643942000/c3f21e71-ba64-41c6-8589-43a20e36767f for MGC192.168.203.123@tcp 00000020:00000080:1.0:1786960885.683319:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff976643941800 for MGC192.168.203.123@tcp 00000020:00000080:1.0:1786960885.683325:0:8:0:(genops.c:906:class_export_put()) final put ffff976643945000/c3f21e71-ba64-41c6-8589-43a20e36767f 00000020:00000080:1.0:1786960885.683328:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff976643945000/c3f21e71-ba64-41c6-8589-43a20e36767f for MGC192.168.203.123@tcp 00000020:01000000:1.0:1786960885.683337:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.123@tcp (c3f21e71-ba64-41c6-8589-43a20e36767f) 00000020:00000080:1.0:1786960885.683634:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667b0be000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1786960885.701526:0:13361:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1786960885.701539:0:13361:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786960885.701544:0:13361:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786960885.701554:0:13361:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1786960885.701635:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1786960885.703081:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97667a685800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1786960885.703113:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:2.0:1786960885.703306:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff976652253e00:5793] 0 exiting: rc = 1 00000100:00100000:2.0:1786960885.703388:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97664e4bf800:5794] 1 exiting: rc = 0 00000100:00100000:2.0:1786960885.703470:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960885.704049:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97664e4be400:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1786960885.704540:0:13041:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff976541c44000:13041] 4 exiting: rc = 0 00000100:00100000:1.0:1786960885.707253:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97664e4bf400:5797] 2 exiting: rc = 0 00000100:00100000:2.0:1786960885.708586:0:6673:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97667727da00:6673] 3 exiting: rc = 0 00000100:00100000:2.0:1786960885.716343:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97664e4bea00:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1786960885.716687:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716697:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716704:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716711:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716719:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716726:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716732:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716738:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716745:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716750:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716755:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716760:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716767:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716773:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716780:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716786:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716793:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716817:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716823:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716829:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716836:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716841:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716847:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716853:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716859:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716865:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716877:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716882:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716889:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716895:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716900:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716905:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716911:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716916:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716922:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716927:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716933:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716939:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716944:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716949:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716955:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716960:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716965:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716971:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716977:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716982:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716987:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716992:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.716998:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717003:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717008:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717015:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717030:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717037:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717042:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717048:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717055:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717060:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717065:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717070:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717075:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717080:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717085:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.717091:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1786960885.718113:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786960885.718126:0:13361:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1786960885.718133:0:13361:0:(genops.c:906:class_export_put()) final put ffff97667ac88800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1786960885.718139:0:13361:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ac88800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1786960885.718146:0:13361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1786960885.718479:0:13361:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766772e6000 1 00000020:00000080:1.0:1786960885.718487:0:13361:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x1808d16e4c97f3c4 00000020:00000080:1.0:1786960885.718493:0:13361:0:(genops.c:906:class_export_put()) final put ffff97667ac8a800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1786960885.718522:0:13361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1786960885.718528:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786960885.718534:0:13361:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786960885.718539:0:13361:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97667a6e99c0) has no exports 00000020:00000080:2.0:1786960885.718915:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff97667ac8a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1786960885.730776:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786960885.730798:0:13361:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1786960885.730807:0:13361:0:(genops.c:906:class_export_put()) final put ffff9766772e3000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1786960885.730813:0:13361:0:(genops.c:865:class_export_destroy()) destroying export ffff9766772e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1786960885.730825:0:13361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1786960885.731067:0:13361:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9766772e4000 00000020:01000000:2.0:1786960885.731094:0:13361:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1786960885.731098:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786960885.731103:0:13361:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786960885.731107:0:13361:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff976673e819c0) has no exports 00000020:00000080:2.0:1786960885.731136:0:13361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786960885.731143:0:13361:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1786960885.731158:0:13361:0:(genops.c:906:class_export_put()) final put ffff97664e57d800/OSS_uuid 00000020:00000080:2.0:1786960885.731161:0:13361:0:(genops.c:865:class_export_destroy()) destroying export ffff97664e57d800/OSS_uuid for OSS 00000020:01000000:2.0:1786960885.731165:0:13361:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1786960885.731220:0:5806:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1786960885.731392:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97664e514c00:6658] 0 exiting: rc = 1 00000100:00100000:2.0:1786960885.732336:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97666b7f6000:6659] 1 exiting: rc = 0 00000100:00100000:2.0:1786960885.732406:0:8239:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9766770be600:8239] 3 exiting: rc = 0 00000100:00100000:2.0:1786960885.733283:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97664e515600:6660] 2 exiting: rc = 0 00000100:00100000:2.0:1786960885.733383:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733400:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733414:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733425:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733431:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733437:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733442:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733447:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733454:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733459:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733464:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733469:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733474:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733479:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733484:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733489:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733494:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733499:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733514:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733520:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733526:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733532:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733537:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733543:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733548:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733554:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733576:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733581:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733587:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733592:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733598:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733603:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733610:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733616:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733622:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733628:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.733992:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734003:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734008:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734014:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734020:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734026:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734034:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734041:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734047:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734053:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734060:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734065:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734071:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734077:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734082:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734087:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734093:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734098:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734103:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734108:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734114:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734119:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734124:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734130:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734135:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734151:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734156:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.734162:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786960885.738311:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff976652353400:6662] 1 exiting: rc = 0 00000100:00100000:0.0:1786960885.751702:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97664e514e00:6661] 0 exiting: rc = 1 00000100:00100000:2.0:1786960885.751971:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.751996:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752002:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752007:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752014:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752019:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752024:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752029:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752035:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752041:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752047:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752053:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752059:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752066:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752073:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752078:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752083:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752089:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752094:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752101:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752108:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752113:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752119:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752125:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752131:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752137:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752142:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752148:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752154:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752160:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752166:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752171:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752231:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752237:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752248:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752259:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752266:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752272:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752278:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752284:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752291:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752298:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752304:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752316:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752322:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752328:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752333:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752339:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752345:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752350:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752357:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752363:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752369:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752374:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752379:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752384:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752390:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752396:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752618:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752626:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752632:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752638:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752643:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.752661:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.755554:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff976643ebc400:6665] 2 exiting: rc = 0 00000100:00100000:0.0:1786960885.755813:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97664e4bd400:6664] 1 exiting: rc = 0 00000100:00100000:1.0:1786960885.757053:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9766516d3400:6663] 0 exiting: rc = 1 00000100:00100000:2.0:1786960885.757232:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757242:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757251:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757267:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757273:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757279:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757285:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757291:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757299:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757306:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757316:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757323:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757328:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757334:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757340:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757350:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757356:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.757362:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758030:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758047:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758056:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758065:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758073:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758080:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758092:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758165:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758545:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758556:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758562:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.758574:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759159:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759168:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759173:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759179:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759217:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759226:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759232:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759238:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759259:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759265:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759272:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759278:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759285:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759291:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759297:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759302:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759307:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759313:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759319:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759325:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759348:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759360:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759366:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759556:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759564:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759571:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759579:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759585:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759592:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759610:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759617:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759624:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759631:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.759637:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786960885.774518:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97666b7f7400:6667] 1 exiting: rc = 0 00000100:00100000:0.0:1786960885.774606:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff976681a06000:6666] 0 exiting: rc = 1 00000100:00100000:2.0:1786960885.774726:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774796:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774805:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774811:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774819:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774827:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774834:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774842:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774848:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774870:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774875:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774881:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774887:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774892:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774898:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774904:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774909:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774914:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774920:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774926:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774932:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774939:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.774945:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775119:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775130:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775136:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775142:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775147:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775153:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775159:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775165:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775171:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775177:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775184:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775279:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775286:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775292:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775298:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775304:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775310:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775315:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775321:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775327:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775333:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775348:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775354:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775360:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775366:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775371:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775377:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775390:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775400:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775406:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775413:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775419:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775424:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775430:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775435:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775440:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775446:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775451:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775457:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775462:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.775468:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786960885.778392:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff976646085400:6668] 0 exiting: rc = 1 00000100:00100000:0.0:1786960885.778548:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff976646085e00:6669] 1 exiting: rc = 0 00000100:00100000:2.0:1786960885.778680:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778692:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778699:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778706:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778730:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778799:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778806:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778813:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778821:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778828:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778836:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778844:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778851:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778858:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778865:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778891:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778914:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778922:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778929:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778935:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778942:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.778948:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779178:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779632:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779645:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779652:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779658:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779665:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779690:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779699:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779708:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779715:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779722:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779729:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779832:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779840:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779848:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779855:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779864:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779871:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779895:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779904:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779911:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779918:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779927:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779935:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779942:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779963:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779971:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779978:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.779996:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780003:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780028:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780039:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780046:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780053:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780061:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780069:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780080:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780087:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780095:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780101:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780108:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786960885.780116:0:13361:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1786960885.797461:0:13361:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1786960902.917503:0:13978:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1786960913.223136:0:14439:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786960913.223141:0:14439:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1786960913.223283:0:14439:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9766818d0000 00000020:01000004:2.0:1786960913.223299:0:14439:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1786960913.223308:0:14439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786960913.223332:0:14439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97664e468000) 00000020:00000080:2.0:1786960913.223347:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786960913.250824:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786960913.257787:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1786960913.258846:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:3.0:1786960913.260658:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786960913.260752:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:3.0:1786960913.260879:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1786960913.262348:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1786960913.263071:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1786960913.264603:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1786960913.264958:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 385: rc = 0 00100000:10000000:2.0:1786960913.271539:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 524: rc = 0 00100000:10000000:2.0:1786960913.271655:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 524: rc = 0 00100000:10000000:2.0:1786960913.273641:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:2.0:1786960913.274313:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.274830:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.275999:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.276338:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:2.0:1786960913.278542:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:2.0:1786960913.278817:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:2.0:1786960913.279100:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.281931:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.282249:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00100000:10000000:2.0:1786960913.283051:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 643: rc = 0 00100000:10000000:2.0:1786960913.285784:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:2.0:1786960913.286252:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:2.0:1786960913.287281:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:2.0:1786960913.287818:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:2.0:1786960913.289912:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:2.0:1786960913.290232:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:2.0:1786960913.291045:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:2.0:1786960913.291784:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:2.0:1786960913.292811:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:2.0:1786960913.295093:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:3.0:1786960913.299845:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:3.0:1786960913.303385:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:3.0:1786960913.303671:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:3.0:1786960913.303911:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:3.0:1786960913.304151:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:3.0:1786960913.304453:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:3.0:1786960913.304698:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:3.0:1786960913.304937:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:3.0:1786960913.305170:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:3.0:1786960913.307753:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:3.0:1786960913.309649:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:3.0:1786960913.310636:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:3.0:1786960913.311672:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:3.0:1786960913.312784:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:3.0:1786960913.313740:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:3.0:1786960913.315156:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:3.0:1786960913.315869:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:3.0:1786960913.316133:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:3.0:1786960913.316427:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:3.0:1786960913.317930:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:3.0:1786960913.318215:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:3.0:1786960913.323333:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:2.0:1786960913.328110:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:2.0:1786960913.328840:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 651: rc = 0 00100000:10000000:2.0:1786960913.329439:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1786960913.329592:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 525: rc = 0 00100000:10000000:2.0:1786960913.329786:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1786960913.329859:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 525: rc = 0 00100000:10000000:2.0:1786960913.330038:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1786960913.330100:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 525: rc = 0 00100000:10000000:2.0:1786960913.330459:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1786960913.330530:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 529: rc = 0 00100000:10000000:2.0:1786960913.330736:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1786960913.330803:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 529: rc = 0 00100000:10000000:2.0:1786960913.330987:0:14439:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1786960913.331058:0:14439:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 529: rc = 0 00000020:00000080:2.0:1786960913.334290:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786960913.334301:0:14439:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786960913.334329:0:14439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c9804e9 00000020:01000004:2.0:1786960913.334338:0:14439:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1786960913.334343:0:14439:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786960913.334350:0:14439:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9766818d0000 from MGS 00000020:01000004:2.0:1786960913.334354:0:14439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786960913.334370:0:14439:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97664e46cd40) 00000020:00000080:2.0:1786960913.334382:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786960913.335046:0:14439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766818d0000 from MGS, refs=2 00080000:01000000:2.0:1786960913.335053:0:14439:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786960913.335059:0:14439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c9804f7 00000100:00100000:2.0:1786960913.335811:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786960913.336361:0:14439:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786960913.336368:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786960913.339380:0:14439:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786960913.339408:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786960913.341893:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960913.342066:0:14439:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786960913.342072:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1786960913.343584:0:14439:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1786960913.343593:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786960913.344303:0:14439:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786960913.344311:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1786960913.345344:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960913.345348:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960913.345350:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960913.346683:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960913.346688:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960913.346691:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960913.351216:0:14439:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1786960913.353597:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1786960913.386645:0:14439:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1786960913.394418:0:14439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786960913.394425:0:14439:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1786960913.398815:0:14448:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1786960913.400305:0:14439:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1786960913.400620:0:14439:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786960913.402712:0:14439:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1786960913.403790:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960913.405660:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1786960913.405668:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786960913.412227:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1786960913.412243:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1786960913.413310:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1786960913.413329:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1786960913.418981:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1786960913.419014:0:14439:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:3.0:1786960913.419016:0:14439:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1786960913.419046:0:14439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:3.0:1786960913.419059:0:14439:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (ffff97667a6e8000) 00000020:00000080:3.0:1786960913.419076:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1786960913.419146:0:14439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff976652341800@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960913.419334:0:14439:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:3.0:1786960913.419341:0:14439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 00000100:00080000:2.0:1786960913.420989:0:14453:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1786960913.422361:0:14454:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1786960913.422616:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid cb0b67db-59e1-45af-922e-ea66d8c1a263) 00000020:00000080:3.0:1786960913.422641:0:14439:0:(genops.c:1406:class_connect()) connect: client cb0b67db-59e1-45af-922e-ea66d8c1a263, cookie 0x1808d16e4c980505 00000100:00080000:3.0:1786960913.422653:0:14439:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960913.422659:0:14439:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff976652341800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960913.422692:0:14439:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace6a00 x1873763967783680/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786960913.422719:0:14439:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cb0b67db-59e1-45af-922e-ea66d8c1a263->MGS 00000020:01000004:3.0:1786960913.422740:0:14439:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1786960913.422745:0:14439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1786960913.422757:0:14439:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97667a6eb380) 00000020:00000080:3.0:1786960913.422768:0:14439:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1786960913.423376:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb0b67db-59e1-45af-922e-ea66d8c1a263:3284:1873763967783680:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1786960913.423473:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960913.425671:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967783680 00000100:00100000:1.0:1786960913.425684:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967783680 00000100:00100000:1.0:1786960913.425723:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960913.425732:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1873763967783680:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1786960913.425767:0:14449:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from cb0b67db-59e1-45af-922e-ea66d8c1a263@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:1.0:1786960913.425797:0:14449:0:(genops.c:1406:class_connect()) connect: client cb0b67db-59e1-45af-922e-ea66d8c1a263, cookie 0x1808d16e4c980513 00000100:00080000:1.0:1786960913.425934:0:14449:0:(import.c:65:import_set_state_nolock()) ffff9766739fc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786960913.426017:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:3284:x1873763967783680:12345-0@lo:250:mount.lustre.0 Request processed in 285us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960913.426024:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960913.426534:0:3284:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1786960913.426545:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:2.0:1786960913.426553:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1786960913.426558:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1786960913.426561:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976652341800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1786960913.426563:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1786960913.426571:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1786960913.426576:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb0b67db-59e1-45af-922e-ea66d8c1a263:3284:1873763967783680:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1786960913.446052:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960913.446264:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1786960913.446270:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1786960913.466152:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1786960913.466164:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1786960913.493775:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1786960913.493789:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1786960913.507644:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960913.507811:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1786960913.507817:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1786960913.509298:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1786960913.509308:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1786960913.672745:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960913.673610:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1786960913.673621:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1786960913.674815:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1786960913.674830:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786960913.676136:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960913.676350:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786960913.676357:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1786960913.677727:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786960913.677738:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1786960913.678590:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786960913.678748:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786960913.678754:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1786960913.679510:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786960913.679518:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1786960913.679996:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786960913.680128:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786960913.680133:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1786960913.680667:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786960913.680674:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1786960913.743830:0:14439:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960913.744019:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786960913.744025:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1786960913.753021:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1786960913.753035:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1786960913.765507:0:14439:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786960913.765527:0:14439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1786960913.766588:0:14439:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1786960913.766610:0:14439:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1786960913.766616:0:14439:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1786960913.766740:0:14439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786960913.766777:0:14439:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1786960913.766781:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786960913.766782:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960913.766784:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960913.766785:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960913.766786:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960913.766787:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960913.766789:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960913.766790:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960913.766792:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960913.766794:0:14439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786960913.766796:0:14439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1786960913.766798:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786960913.766799:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960913.766800:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960913.766801:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960913.766803:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960913.766804:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960913.766805:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960913.766806:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960913.766807:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960913.766808:0:14439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786960913.766832:0:14439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1786960913.766850:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967783808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786960913.766916:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960913.766970:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960913.767175:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967783808 00000100:00100000:3.0:1786960913.767216:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967783808 00000100:00100000:3.0:1786960913.767269:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960913.767279:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:14439:x1873763967783808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786960913.767352:0:14452:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786960913.767356:0:14452:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1786960913.767359:0:14452:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1786960913.767957:0:14473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786960913.768361:0:14452:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1786960913.777753:0:14474:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1786960913.777762:0:14474:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1786960913.777764:0:14474:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1786960913.777798:0:14474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1786960913.778222:0:14452:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786960913.778233:0:14452:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1786960913.793665:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:14439:x1873763967783808:12345-0@lo:253:mount.lustre.0 Request processed in 26379us (26740us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960913.793680:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960913.793857:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967783808:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786960913.793872:0:14439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1786960913.793875:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786960913.793877:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1786960913.793878:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960913.793879:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960913.793895:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960913.793896:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960913.793898:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1786960913.793899:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1786960913.793901:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960913.793903:0:14439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786960913.793926:0:14439:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9766818d0000 from lustre-MDT0000 10000000:01000000:2.0:1786960913.793953:0:14439:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1786960913.793956:0:14439:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1786960913.793961:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97667a6e8000 10000000:01000000:2.0:1786960913.793965:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786960913.793973:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97667a6e8000 from 1 10000000:01000000:2.0:1786960913.793976:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786960913.794014:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.794025:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.794036:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960913.794056:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967783936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786960913.794093:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960913.794146:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960913.794577:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967783936 00000100:00100000:3.0:1786960913.794583:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967783936 00000100:00100000:3.0:1786960913.794628:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960913.794637:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:14439:x1873763967783936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960913.794648:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960913.794663:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044e00/0x1808d16e4c980521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c98051a expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.794685:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044e00/0x1808d16e4c980521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c98051a expref: 6 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.794696:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044e00/0x1808d16e4c980521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98051a expref: 6 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.794706:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044e00, rc 0) 00000100:00100000:3.0:1786960913.794749:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+6:14439:x1873763967783936:12345-0@lo:101:mount.lustre.0 Request processed in 113us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960913.794755:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960913.794888:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967783936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960913.794902:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.794911:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960913.794970:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786960913.794996:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960913.795022:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960913.795080:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784064 00000100:00100000:1.0:1786960913.795085:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784064 00000100:00100000:1.0:1786960913.795116:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786960913.795124:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+6:14439:x1873763967784064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960913.795532:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784064:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1786960913.795568:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1786960913.795584:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.795591:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960913.795599:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9766818d0000 10000000:01000000:0.0:1786960913.795604:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786960913.795607:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9766818d0000 10000000:01000000:0.0:1786960913.795609:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1786960913.795612:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9766818d0000 from 1 10000000:01000000:0.0:1786960913.795614:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1786960913.795631:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.795637:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.795644:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960913.795668:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786960913.796961:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960913.796999:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655694000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960913.797055:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784192 00000100:00100000:2.0:1786960913.797062:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784192 00000100:00100000:2.0:1786960913.797100:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960913.797109:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+7:14439:x1873763967784192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960913.797119:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960913.797133:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5ec00/0x1808d16e4c98052f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980528 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.797153:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5ec00/0x1808d16e4c98052f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980528 expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.797162:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5ec00/0x1808d16e4c98052f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980528 expref: 8 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960913.797171:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ec00, rc 0) 00000100:00100000:2.0:1786960913.797253:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+8:14439:x1873763967784192:12345-0@lo:101:mount.lustre.0 Request processed in 145us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960913.797260:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786960913.797570:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786960913.797586:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98052f expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.797594:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98052f expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960913.797612:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1786960913.797628:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98052f expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.797636:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976677927200/0x1808d16e4c980528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98052f expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960913.797644:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1786960913.797649:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786960913.797653:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9766818d0000 10000000:01000000:0.0:1786960913.797656:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1786960913.797659:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1786960913.797662:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786960913.797679:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.797686:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.797704:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960913.797720:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786960913.797749:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960913.797776:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655694000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960913.797880:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784320 00000100:00100000:3.0:1786960913.797884:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784320 00000100:00100000:3.0:1786960913.797917:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960913.797925:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+8:14439:x1873763967784320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960913.797933:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960913.797942:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045c00/0x1808d16e4c98053d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980536 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.797957:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045c00/0x1808d16e4c98053d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980536 expref: 9 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.797965:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045c00/0x1808d16e4c98053d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980536 expref: 9 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960913.797972:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045c00, rc 0) 00000100:00100000:3.0:1786960913.798003:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14439:x1873763967784320:12345-0@lo:101:mount.lustre.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960913.798009:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786960913.798143:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+8:14439:x1873763967784064:12345-0@lo:501:mount.lustre.0 Request processed in 3018us (3144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786960913.798152:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960913.798887:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786960913.798901:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98053d expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960913.798911:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98053d expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960913.798961:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960913.798986:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960913.799014:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655694000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960913.799062:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784448 00000100:00100000:3.0:1786960913.799067:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784448 00000100:00100000:3.0:1786960913.799095:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960913.799102:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+8:14439:x1873763967784448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960913.799476:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14439:x1873763967784448:12345-0@lo:501:mount.lustre.0 Request processed in 373us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960913.799484:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786960913.799736:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960913.799762:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786960913.799794:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960913.799819:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655694000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960913.799862:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784576 00000100:00100000:3.0:1786960913.799866:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784576 00000100:00100000:3.0:1786960913.799893:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786960913.799898:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14439:x1873763967784576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786960913.800177:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14439:x1873763967784576:12345-0@lo:503:mount.lustre.0 Request processed in 278us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960913.800208:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786960913.800360:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967784576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786960913.801731:0:14475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14475:1873763967784704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960913.801791:0:14475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960913.801831:0:14475:0:(client.c:2702:ptlrpc_set_wait()) set ffff976655694e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960913.803704:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784704 00000100:00100000:1.0:1786960913.803716:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784704 00000100:00100000:1.0:1786960913.803784:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786960913.803795:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14475:x1873763967784704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960913.804235:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14475:x1873763967784704:12345-0@lo:502:llog_process_th.0 Request processed in 392us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960913.804243:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786960913.804465:0:14475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14475:1873763967784704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786960913.804503:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960913.804514:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960913.804516:0:14475:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786960913.804522:0:14475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1786960913.804526:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786960913.804539:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff976673e83380) 00000020:00000080:0.0:1786960913.804567:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1786960913.804573:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786960913.804642:0:14475:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786960913.804649:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c98054b 00000020:00000080:0.0:1786960913.804868:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786960913.804873:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960913.804876:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960913.804878:0:14475:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786960913.804880:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960913.804884:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960913.804885:0:14475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1786960913.804888:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786960913.804895:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff976673e84d40) 00000020:00000080:0.0:1786960913.804905:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1786960913.804908:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1786960913.804910:0:14475:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1786960913.804913:0:14475:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1786960913.804921:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1786960913.804966:0:14475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766818d0000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1786960913.804979:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff976673e80000) 00000020:00000080:0.0:1786960913.804987:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1786960913.805054:0:14475:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1786960913.805059:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c980560 00000020:00000080:0.0:1786960913.805147:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1786960913.805153:0:14475:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1786960913.805166:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1808d16e4c980567 00080000:01000000:0.0:1786960913.805172:0:14475:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1786960913.805176:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c98056e 00010000:00010000:2.0:1786960914.049943:0:14475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1786960914.051891:0:14475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1786960914.052137:0:14475:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1786960914.067881:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97664e7f3380) 00000020:00000080:1.0:1786960914.067903:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1786960914.067986:0:14475:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1786960914.067994:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c98057c 00000020:00000080:1.0:1786960914.076675:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1786960914.098815:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1808d16e4c980583 00000020:00000080:2.0:1786960914.106490:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1786960914.106504:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.106523:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.106525:0:14475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1786960914.106529:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.106536:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.106537:0:14475:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1786960914.106541:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786960914.106587:0:14475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1786960914.106603:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.106607:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.106608:0:14475:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1786960914.106610:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786960914.106612:0:14475:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1786960914.106614:0:14475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960914.106615:0:14475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960914.106617:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786960914.106619:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.106620:0:14475:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786960914.106623:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786960914.106625:0:14475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1786960914.106628:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.106630:0:14475:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1786960914.106633:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786960914.106638:0:14475:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1786960914.106664:0:14475:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1786960914.106667:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786960914.106680:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97664e46b380) 00000020:00000080:2.0:1786960914.106696:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1786960914.106703:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786960914.106758:0:14475:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1786960914.106764:0:14475:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1786960914.106770:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c980591 00010000:00080000:2.0:1786960914.106801:0:14475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97667a86c800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1786960914.107014:0:14475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1786960914.109332:0:14475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1786960914.109385:0:14475:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786960914.115691:0:14475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960914.115768:0:14475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1786960914.115859:0:14475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1786960914.122633:0:14479:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1786960914.122640:0:14479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786960914.123603:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786960914.123615:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786960914.123645:0:14475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786960914.123664:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c980598 00000100:00080000:2.0:1786960914.123674:0:14475:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786960914.123680:0:14475:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97667a86c800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960914.123714:0:14475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766816e2680 x1873763967784832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786960914.123742:0:14475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786960914.123792:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.123797:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.123799:0:14475:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786960914.123802:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786960914.123804:0:14475:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1786960914.123806:0:14475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960914.123808:0:14475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960914.123809:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786960914.123812:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.123813:0:14475:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786960914.123816:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786960914.123819:0:14475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1786960914.123823:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.123824:0:14475:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1786960914.123827:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786960914.123831:0:14475:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1786960914.123863:0:14475:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1786960914.123865:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786960914.123884:0:14475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97664e4699c0) 00000020:00000080:2.0:1786960914.123896:0:14475:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1786960914.123901:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786960914.123950:0:14475:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1786960914.123956:0:14475:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1786960914.123961:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1808d16e4c9805a6 00010000:00080000:2.0:1786960914.124002:0:14475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97666b709800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1786960914.124223:0:14475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1786960914.124343:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967784960:0@lo:400:kworker.0 00000100:00100000:1.0:1786960914.124403:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1786960914.124417:0:14475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1786960914.124441:0:14475:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1786960914.124482:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967784960 00000100:00100000:1.0:1786960914.124488:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967784960 00000100:00100000:1.0:1786960914.124522:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786960914.124530:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:3286:x1873763967784960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960914.124578:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:3286:x1873763967784960:12345-0@lo:400:kworker.0 Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.124584:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786960914.124624:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967784960:0@lo:400:kworker.0 00000040:00080000:2.0:1786960914.125039:0:14475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960914.125102:0:14475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1786960914.125210:0:14475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1786960914.125584:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967784832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1786960914.125631:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873763967784832 offset 0 length 520: 4 00000040:00080000:2.0:1786960914.129730:0:14481:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1786960914.129739:0:14481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1786960914.135088:0:14475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786960914.135104:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786960914.135140:0:14475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1786960914.135158:0:14475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c9805ad 00000100:00080000:2.0:1786960914.135168:0:14475:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786960914.135174:0:14475:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97666b709800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960914.135254:0:14475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766816e1880 x1873763967785088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786960914.135273:0:14475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1786960914.135338:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.135342:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.135344:0:14475:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1786960914.135347:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.135350:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.135352:0:14475:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960914.135354:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960914.135367:0:14475:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786960914.135385:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.135389:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.135390:0:14475:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786960914.135393:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.135395:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.135396:0:14475:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786960914.135400:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1786960914.135432:0:14475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14475:1873763967785216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960914.135517:0:14475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.135615:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785216 00000100:00100000:1.0:1786960914.135622:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785216 00000100:00100000:1.0:1786960914.135662:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786960914.135669:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14475:x1873763967785216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960914.135934:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967785088:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1786960914.136501:0:14475:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.145724:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14475:x1873763967785216:12345-0@lo:502:llog_process_th.0 Request processed in 10047us (10199us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.145738:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960914.145981:0:14475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14475:1873763967785216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960914.146023:0:14475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.146030:0:14475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.146033:0:14475:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786960914.146037:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1786960914.146223:0:14439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1786960914.146245:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786960914.146262:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98053d expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.146273:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976677926000/0x1808d16e4c980536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98053d expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960914.146282:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9766818d0000 from 1 10000000:01000000:3.0:1786960914.146285:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786960914.146329:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.146337:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.146354:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.146385:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786960914.146427:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.146463:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766451956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.148330:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785344 00000100:00100000:1.0:1786960914.148352:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785344 00000100:00100000:1.0:1786960914.148421:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786960914.148431:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+9:14439:x1873763967785344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960914.148635:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960914.148659:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c9805b4 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.148683:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.148693:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.148702:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92400, rc 0) 00000100:00100000:1.0:1786960914.148772:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+10:14439:x1873763967785344:12345-0@lo:101:mount.lustre.0 Request processed in 343us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.148779:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960914.148878:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960914.148895:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.148922:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.149494:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785472:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1786960914.149534:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.149569:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766451956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.149856:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785472 00000100:00100000:1.0:1786960914.149863:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785472 00000100:00100000:1.0:1786960914.149900:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960914.149908:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+10:14439:x1873763967785472:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1786960914.149924:0:14451:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1786960914.149930:0:14451:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1786960914.150004:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+10:14439:x1873763967785472:12345-0@lo:256:mount.lustre.0 Request processed in 97us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.150011:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786960914.150118:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785472:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1786960914.150694:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786960914.150717:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960914.150727:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960914.150734:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766818d0000 from 1 10000000:01000000:2.0:1786960914.150737:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960914.150760:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960914.150767:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960914.152049:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960914.152078:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786960914.152135:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960914.152168:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a540 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.153215:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785600 00000100:00100000:3.0:1786960914.153224:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785600 00000100:00100000:3.0:1786960914.153277:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786960914.153286:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+10:14439:x1873763967785600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960914.153302:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960914.153332:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c9805c2 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.153359:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.153370:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.153378:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:3.0:1786960914.153433:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967785600:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.153440:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786960914.159064:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960914.159092:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960914.159104:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960914.159183:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786960914.159255:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960914.159305:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666574a540 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.160490:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785728 00000100:00100000:1.0:1786960914.160500:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785728 00000100:00100000:1.0:1786960914.160580:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960914.160591:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967785728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960914.161013:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967785728:12345-0@lo:501:mount.lustre.0 Request processed in 424us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.161021:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000400:00000100:0.0:1786960914.161339:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873763967785088 offset 0 length 520: 4 00000100:00100000:3.0:1786960914.163054:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960914.163114:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786960914.163210:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.163239:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.164229:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785856 00000100:00100000:1.0:1786960914.164239:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785856 00000100:00100000:1.0:1786960914.164292:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786960914.164301:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967785856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960914.164565:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967785856:12345-0@lo:503:mount.lustre.0 Request processed in 264us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.164574:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786960914.164805:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967785856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786960914.168922:0:14483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14483:1873763967785984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960914.169004:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960914.169065:0:14483:0:(client.c:2702:ptlrpc_set_wait()) set ffff976681baf000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.174287:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967785984 00000100:00100000:1.0:1786960914.174302:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967785984 00000100:00100000:1.0:1786960914.174380:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786960914.174389:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14483:x1873763967785984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786960914.174718:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14483:x1873763967785984:12345-0@lo:502:llog_process_th.0 Request processed in 329us (5713us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.174726:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786960914.175013:0:14483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14483:1873763967785984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786960914.175049:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.175058:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.175061:0:14483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786960914.175067:0:14483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766818d0000 00000020:00000080:2.0:1786960914.175070:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786960914.175088:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.175090:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.175091:0:14483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786960914.175094:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.175096:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.175098:0:14483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786960914.175100:0:14483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766818d0000 00000020:00000080:2.0:1786960914.175102:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786960914.175160:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960914.175163:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.175165:0:14483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1786960914.175167:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960914.175170:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960914.175171:0:14483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786960914.175175:0:14483:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9766818d0000 00000020:00000080:2.0:1786960914.175177:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786960914.175258:0:14483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14483:1873763967786112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960914.175304:0:14483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960914.175366:0:14483:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7ed6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.181579:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786112 00000100:00100000:3.0:1786960914.181595:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786112 00000100:00100000:3.0:1786960914.181657:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960914.181668:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14483:x1873763967786112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960914.181942:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14483:x1873763967786112:12345-0@lo:502:llog_process_th.0 Request processed in 276us (6637us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.181950:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960914.182019:0:14483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14483:1873763967786112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1786960914.182053:0:14483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786960914.182060:0:14483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960914.182062:0:14483:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1786960914.182067:0:14483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1786960914.185283:0:14439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1786960914.185336:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960914.185362:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.185375:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960914.185465:0:14439:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786960914.185468:0:14439:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9766818d0000 10000000:01000000:1.0:1786960914.185471:0:14439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9766818d0000 10000000:01000000:1.0:1786960914.185475:0:14439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786960914.185481:0:14439:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9766818d0000 from 1 10000000:01000000:1.0:1786960914.185483:0:14439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960914.185520:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.185528:0:14439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.185538:0:14439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960914.185573:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786960914.185638:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.185674:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.185889:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786240 00000100:00100000:3.0:1786960914.185896:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786240 00000100:00100000:3.0:1786960914.185943:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786960914.185951:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967786240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960914.185965:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960914.185979:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045400/0x1808d16e4c9805d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c9805d0 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.186000:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045400/0x1808d16e4c9805d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c9805d0 expref: 12 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.186009:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045400/0x1808d16e4c9805d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805d0 expref: 12 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.186028:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045400, rc 0) 00000100:00100000:3.0:1786960914.186067:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967786240:12345-0@lo:101:mount.lustre.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.186073:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1786960914.187172:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960914.187227:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805d7 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.187240:0:14439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9805d7 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960914.187305:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960914.187361:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.187403:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.187420:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786368 00000100:00100000:1.0:1786960914.187425:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786368 00000100:00100000:1.0:1786960914.187469:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786960914.187477:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967786368:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960914.187732:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967786368:12345-0@lo:501:mount.lustre.0 Request processed in 255us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.187739:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786960914.187773:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960914.187802:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960914.187837:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.187850:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.188067:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786496 00000100:00100000:1.0:1786960914.188072:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786496 00000100:00100000:1.0:1786960914.188091:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786960914.188097:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967786496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960914.188272:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967786496:12345-0@lo:503:mount.lustre.0 Request processed in 175us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.188279:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786960914.188347:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967786496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786960914.213249:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14485:1873763967786624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960914.213335:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.213377:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786624 00000100:00100000:3.0:1786960914.213383:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786624 00000100:00100000:3.0:1786960914.213441:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786960914.213603:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14485:x1873763967786624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786960914.213847:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14485:x1873763967786624:12345-0@lo:502:llog_process_th.0 Request processed in 397us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.213855:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786960914.213907:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff976645195240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.213928:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14485:1873763967786624:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1786960914.213983:0:14485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786960914.213998:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97667a6e99c0) 00000020:00000080:3.0:1786960914.214023:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1786960914.214181:0:14485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766818d0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786960914.214206:0:14485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9766818d0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786960914.214209:0:14485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766818d0000 4 00010000:00080000:3.0:1786960914.214239:0:14485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97666b70c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960914.222073:0:14485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1786960914.222165:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786960914.222215:0:14485:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786960914.222232:0:14485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1808d16e4c9805e5 00000100:00080000:3.0:1786960914.222244:0:14485:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960914.222249:0:14485:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97666b70c000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960914.222283:0:14485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace7800 x1873763967786752/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786960914.226244:0:14485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786960914.227659:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967786752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786960914.227685:0:14485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14485:1873763967786880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786960914.231001:0:14485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.234284:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.234957:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786752 00000100:00100000:3.0:1786960914.234968:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786752 00000100:00100000:3.0:1786960914.235014:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960914.235022:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1873763967786752:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786960914.235122:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1873763967786752:12345-0@lo:38:llog_process_th.0 Request processed in 99us (844us total) trans 0 rc -11/-11 00000100:00100000:3.0:1786960914.235129:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960914.235183:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786960914.235207:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b70c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786960914.235211:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1786960914.235215:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967786752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786960914.235412:0:14485:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.238097:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967786880 00000100:00100000:1.0:1786960914.238110:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967786880 00000100:00100000:1.0:1786960914.238173:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1786960914.238183:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14485:x1873763967786880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786960914.243536:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14485:x1873763967786880:12345-0@lo:502:llog_process_th.0 Request processed in 4999us (15451us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960914.243558:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786960914.244376:0:14485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb0b67db-59e1-45af-922e-ea66d8c1a263:14485:1873763967786880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786960914.244414:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1786960914.244673:0:14439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1786960914.244697:0:14439:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786960914.244719:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805d7 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.244731:0:14439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976642e92c00/0x1808d16e4c9805d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805d7 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786960914.244779:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786960914.244782:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786960914.244783:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960914.244784:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960914.244786:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960914.244787:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960914.244788:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786960914.244790:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786960914.244792:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960914.244793:0:14439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786960914.244797:0:14439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1786960914.244800:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786960914.244801:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786960914.244803:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960914.244804:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960914.244805:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960914.244806:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960914.244807:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786960914.244809:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786960914.244810:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960914.244811:0:14439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786960914.244834:0:14439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786960914.244850:0:14439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967787008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786960914.244904:0:14439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.244941:0:14439:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664670ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.245249:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787008 00000100:00100000:3.0:1786960914.245256:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787008 00000100:00100000:3.0:1786960914.245303:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786960914.245311:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14439:x1873763967787008:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786960914.245344:0:14452:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1786960914.245356:0:14452:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1786960914.331363:0:14452:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1786960914.331399:0:14452:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786960914.331461:0:14473:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786960914.331466:0:14473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786960914.331487:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.331518:0:14473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.331526:0:14473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.331562:0:14473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.331577:0:14473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 12 pid: 14449 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.331592:0:14473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967787136:0@lo:104: 00000100:00100000:3.0:1786960914.331652:0:14473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.331706:0:14473:0:(client.c:2702:ptlrpc_set_wait()) set ffff976673e42cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960914.334533:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787136 00000100:00100000:1.0:1786960914.334546:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787136 00000100:00100000:1.0:1786960914.334603:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960914.334614:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967787136:12345-0@lo:104: 00010000:00010000:1.0:1786960914.334643:0:14440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334743:0:14440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786960914.334749:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967787136:12345-0@lo:104: Request processed in 138us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.334756:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1786960914.334775:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1786960914.334780:0:14473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967787136:0@lo:104: 00010000:00010000:1.0:1786960914.334781:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334788:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045000 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:1.0:1786960914.334792:0:14446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334800:0:14446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960914.334802:0:14473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786960914.334807:0:14446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960914.334812:0:14446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786960914.334842:0:14446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334858:0:14446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786960914.334884:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334891:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682045000/0x1808d16e4c9805b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805bb expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.334914:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960914.334915:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960914.334917:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960914.335136:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967787264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786960914.335174:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960914.335338:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787264 00000100:00100000:1.0:1786960914.335343:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787264 00010000:00010000:1.0:1786960914.335361:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 13 pid: 14449 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960914.335826:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960914.335835:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+13:3287:x1873763967787264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786960914.335848:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960914.335854:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 13 pid: 14449 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335865:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 13 pid: 14449 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335880:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976642e92400/0x1808d16e4c9805bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c9805b4 expref: 13 pid: 14449 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335893:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335900:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786960914.335913:0:14442:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004447155s 00010000:00010000:1.0:1786960914.335917:0:14442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335935:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335942:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335948:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335955:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960914.335959:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335967:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335979:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960914.335988:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960914.336023:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:3287:x1873763967787264:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960914.336030:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960914.336035:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967787264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786960914.336114:0:14473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960914.336122:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960914.336128:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045e00/0x1808d16e4c9805ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.354054:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14439:x1873763967787008:12345-0@lo:253:mount.lustre.0 Request processed in 108734us (109141us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.354068:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786960914.354225:0:14439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:14439:1873763967787008:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786960914.354245:0:14439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786960914.354248:0:14439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786960914.354250:0:14439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786960914.354251:0:14439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960914.354252:0:14439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960914.354254:0:14439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960914.354267:0:14439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960914.354269:0:14439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786960914.354271:0:14439:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786960914.354273:0:14439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960914.354275:0:14439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786960914.354291:0:14439:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1786960914.365675:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1786960914.368787:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960914.368956:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960914.369275:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960914.369452:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960914.369713:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960914.369871:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960914.373948:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960914.374121:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960914.384634:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960914.384985:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960914.386760:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960914.386964:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1786960914.461809:0:14439:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1786960914.462752:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1786960914.462835:0:14495:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1786960914.462839:0:14495:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1786960914.465840:0:14496:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1786960914.465947:0:14496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1786960914.472059:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1786960914.472286:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786960914.474089:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1786960914.474162:0:14496:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1786960914.474166:0:14496:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1786960914.477347:0:14439:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1786960914.480867:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1786960914.481160:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960914.484231:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1786960914.485171:0:14439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1786960914.485239:0:14439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1786960914.486167:0:14439:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1786960914.499518:0:14439:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1786960914.515095:0:14439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1786960914.624081:0:14439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1786960914.624119:0:14439:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3e2c1653988 00100000:10000000:1.0:1786960914.624127:0:14439:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1786960914.626633:0:14439:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786960914.626652:0:14439:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786960914.626666:0:14439:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1786960914.626682:0:14439:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:3.0:1786960914.707611:0:14454:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786960914.707616:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9766818d0000 from 6 10000000:01000000:3.0:1786960914.707627:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786960914.707667:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.707678:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.707690:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.707714:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967787392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786960914.707792:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.707842:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807840 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.707877:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787392 00000100:00100000:3.0:1786960914.707884:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787392 00000100:00100000:3.0:1786960914.707929:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960914.707939:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14454:x1873763967787392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960914.707951:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960914.707963:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c9805f3 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.707986:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.707996:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.708005:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044800, rc 0) 00000100:00100000:3.0:1786960914.708039:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967787392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.708054:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786960914.708097:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967787392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960914.708109:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.708118:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960914.708164:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967787520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786960914.708208:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960914.708221:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807840 going to sleep for 11 seconds 00000100:00100000:3.0:1786960914.708233:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787520 00000100:00100000:3.0:1786960914.708236:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787520 00000100:00100000:3.0:1786960914.708256:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786960914.708262:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967787520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786960914.708275:0:14452:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786960914.708289:0:14452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786960914.708292:0:14452:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1786960914.708378:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967787520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960914.708385:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786960914.708416:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967787520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786960914.708587:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786960914.708595:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960914.708612:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960915.253733:0:14491:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960915.253742:0:14491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960915.254147:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1786960915.254154:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1786960915.381092:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786960916.276832:0:14491:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786960916.276848:0:14491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960916.282209:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1786960916.282997:0:14491:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786960916.284367:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:3.0:1786960916.407952:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960917.437487:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960918.454030:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786960919.357436:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960919.357442:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786960919.357445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960919.357448:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786960919.357451:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1786960919.357454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1786960919.357457:0:8:0:(import.c:65:import_set_state_nolock()) ffff97666b70c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786960919.357468:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97666b70c000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960919.357490:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace7480 x1873763967787776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786960919.357539:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967787648:0@lo:400:kworker.0 00000100:00100000:3.0:1786960919.357617:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960919.357684:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787648 00000100:00100000:3.0:1786960919.357692:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787648 00000100:00100000:3.0:1786960919.357735:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960919.357742:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:3288:x1873763967787648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960919.357789:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:3288:x1873763967787648:12345-0@lo:400:kworker.0 Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960919.357804:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960919.359441:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967787648:0@lo:400:kworker.0 00000100:00100000:2.0:1786960919.360474:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967787776:0@lo:38:kworker.0 00000100:00100000:2.0:1786960919.360696:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960919.361113:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787776 00000100:00100000:3.0:1786960919.361122:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787776 00000100:00100000:3.0:1786960919.361157:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960919.361164:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1873763967787776:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1786960919.361215:0:14459:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:3.0:1786960919.361249:0:14459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1808d16e4c980601 00000004:00100000:3.0:1786960919.362054:0:14459:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786960919.362177:0:14459:0:(import.c:65:import_set_state_nolock()) ffff97667a684800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960919.362872:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1873763967787776:12345-0@lo:38:kworker.0 Request processed in 1703us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960919.362883:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786960919.362968:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97667ace7480 x1873763967787776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786960919.362986:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786960919.362994:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1786960919.362999:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786960919.363001:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b70c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786960919.363008:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1873763967787776:0@lo:38:kworker.0 00010000:00010000:3.0:1786960919.476745:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786960919.721448:0:14739:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1786960920.501379:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960921.526516:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960922.548355:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786960923.079700:0:14891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe625e3780 20000000:00000080:0.0:1786960923.079713:0:14891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97667c8a8400 uarg=0000000000000000 20000000:01000000:0.0:1786960923.079739:0:14891:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1786960923.079744:0:14891:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1786960923.079752:0:14891:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1786960923.080944:0:14892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1786960923.081029:0:14891:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786960923.090890:0:14891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1786960923.090920:0:14891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.090937:0:14891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.090945:0:14891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.090985:0:14891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.090999:0:14891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960923.091014:0:14891:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14891:1873763967787904:0@lo:104: 00000100:00100000:0.0:1786960923.091080:0:14891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960923.091138:0:14891:0:(client.c:2702:ptlrpc_set_wait()) set ffff976648e87d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786960923.091432:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967787904 00000100:00100000:2.0:1786960923.091441:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967787904 00000100:00100000:2.0:1786960923.091500:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960923.091510:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14891:x1873763967787904:12345-0@lo:104: 00010000:00010000:2.0:1786960923.091522:0:14441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091598:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960923.091604:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14891:x1873763967787904:12345-0@lo:104: Request processed in 97us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960923.091611:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1786960923.091631:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960923.091636:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091643:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960923.091647:0:14446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091656:0:14446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960923.091676:0:14446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960923.091682:0:14446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786960923.091727:0:14446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091734:0:14446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960923.091753:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091759:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff97667ae5fa00/0x1808d16e4c9805c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805c9 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091774:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960923.091776:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960923.091777:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960923.091788:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967788032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960923.091815:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960923.091860:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788032 00000100:00100000:2.0:1786960923.091864:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788032 00010000:00010000:2.0:1786960923.091881:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 12 pid: 14452 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960923.091901:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960923.091908:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:3285:x1873763967788032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960923.091917:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960923.091922:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 12 pid: 14452 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091939:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 12 pid: 14452 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091952:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091959:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091971:0:14442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091979:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091985:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091990:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.091996:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960923.091999:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.092005:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.092013:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960923.092032:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960923.092070:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:3285:x1873763967788032:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960923.092078:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786960923.092180:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967788032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786960923.092900:0:14891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044a00/0x1808d16e4c9805c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c9805c2 expref: 11 pid: 14452 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960923.092913:0:14891:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14891:1873763967787904:0@lo:104: 00010000:00010000:0.0:1786960923.092930:0:14891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.092940:0:14891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.092959:0:14891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960923.092964:0:14891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976677927800/0x1808d16e4c980608 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960923.572454:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786960924.468487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960924.468502:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786960924.468505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960924.468508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786960924.468562:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967788160:0@lo:400:kworker.0 00000100:00100000:3.0:1786960924.468869:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960924.469072:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967788288:0@lo:400:kworker.0 00000100:00100000:3.0:1786960924.469113:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960924.469173:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788288 00000100:00100000:3.0:1786960924.469184:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788288 00000100:00100000:3.0:1786960924.469266:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960924.469277:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967788288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960924.469338:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967788288:12345-0@lo:400:kworker.0 Request processed in 63us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960924.469345:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786960924.469395:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97667ace6d80 x1873763967788288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960924.470058:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967788288:0@lo:400:kworker.0 00000100:00100000:3.0:1786960924.471093:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960914/real 1786960914] req@ffff9766816e1880 x1873763967785088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960924 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960924.471124:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766816e1880 x1873763967785088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960924 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960924.471135:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960914/real 1786960914] req@ffff9766816e2680 x1873763967784832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960924 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960924.471174:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9766816e2680 x1873763967784832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960924 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786960924.471206:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786960924.471229:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786960924.471233:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967785088:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1786960924.471239:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786960924.471259:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786960924.471262:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967784832:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1786960924.471296:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960924.471301:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1786960924.471304:0:8:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786960924.471310:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:3.0:1786960924.471315:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786960924.471323:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97667a86c800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960924.471362:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace6d80 x1873763967788416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786960924.471380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960924.471384:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786960924.471385:0:8:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786960924.471402:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00100000:2.0:1786960924.471756:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967788416:0@lo:8:kworker.0 00000400:00000100:2.0:1786960924.471815:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873763967788416 offset 0 length 520: 4 00000100:00100000:0.0:1786960924.472943:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788160 00000100:00100000:0.0:1786960924.472959:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788160 00000100:00100000:0.0:1786960924.473030:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786960924.473043:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:3286:x1873763967788160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960924.473141:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:3286:x1873763967788160:12345-0@lo:400:kworker.0 Request processed in 101us (4273us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960924.473150:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786960924.473235:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967788160:0@lo:400:kworker.0 00000100:00080000:3.0:1786960924.474099:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1786960924.474112:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97666b709800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960924.474162:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace4380 x1873763967788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786960924.475060:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967788544:0@lo:8:kworker.0 00000400:00000100:2.0:1786960924.475130:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873763967788544 offset 0 length 520: 4 10000000:01000000:1.0:1786960924.596379:0:14454:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786960924.596389:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766818d0000 from 10 10000000:01000000:1.0:1786960924.596397:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960924.596460:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960924.596475:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960924.596489:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960924.596524:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960924.596642:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960924.596707:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7edf00 going to sleep for 11 seconds 00010000:00010000:2.0:1786960924.597722:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960924.597870:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788672 00000100:00100000:3.0:1786960924.597882:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788672 00000100:00100000:3.0:1786960924.597956:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786960924.597967:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+11:14454:x1873763967788672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960924.597988:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960924.598009:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c98060f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960924.598041:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c98060f expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960924.598055:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98060f expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960924.598066:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045000, rc 0) 00000100:00100000:3.0:1786960924.598148:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967788672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960924.598156:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786960924.598388:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960924.598539:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960924.598551:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960924.598640:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960924.598678:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960924.598726:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960924.598814:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788800 00000100:00100000:0.0:1786960924.598820:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788800 00000100:00100000:0.0:1786960924.598848:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1786960924.598856:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967788800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960924.599171:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967788800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960924.599180:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786960924.599383:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786960924.605712:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786960924.605832:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960924.605891:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664133a240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960924.606347:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967788928 00000100:00100000:1.0:1786960924.606358:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967788928 00000100:00100000:1.0:1786960924.606526:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786960924.606538:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967788928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960924.606784:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:14454:x1873763967788928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960924.606792:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786960924.606864:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967788928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786960924.608630:0:14959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1786960924.608873:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1786960924.608899:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960924.608913:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960924.608928:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960925.621103:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786960926.517808:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786960926.646497:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960927.670707:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786960928.228878:0:15140:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786960928.228882:0:15140:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1786960928.229019:0:15140:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9766520b1800 00000020:01000004:2.0:1786960928.229034:0:15140:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1786960928.229045:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786960928.229067:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9766523619c0) 00000020:00000080:2.0:1786960928.229083:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786960928.256375:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786960928.256995:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786960928.257864:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786960928.258099:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1786960928.258389:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786960928.258688:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1786960928.258764:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1786960928.259045:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1786960928.259639:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 717: rc = 0 00100000:10000000:3.0:1786960928.259932:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 717: rc = 0 00100000:10000000:3.0:1786960928.260161:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 717: rc = 0 00100000:10000000:3.0:1786960928.260408:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 717: rc = 0 00100000:10000000:3.0:1786960928.260619:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 717: rc = 0 00100000:10000000:3.0:1786960928.260832:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 717: rc = 0 00000020:00000080:3.0:1786960928.261451:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786960928.261461:0:15140:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786960928.261473:0:15140:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1808d16e4c980624 00000020:01000004:3.0:1786960928.261480:0:15140:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786960928.261500:0:15140:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786960928.261504:0:15140:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786960928.261510:0:15140:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786960928.261514:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786960928.261525:0:15140:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97667a6ecd40) 00000020:00000080:3.0:1786960928.261534:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1786960928.264175:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786960928.266479:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1786960928.266486:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1786960928.267041:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1786960928.267048:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1786960928.268551:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1786960928.268561:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1786960928.273604:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960928.273791:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1786960928.273798:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1786960928.274936:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1786960928.274944:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1786960928.289958:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960928.290619:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786960928.290627:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1786960928.292039:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786960928.292050:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1786960928.293139:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786960928.293148:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1786960928.294891:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786960928.295066:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1786960928.295072:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1786960928.296401:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1786960928.296410:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1786960928.334088:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786960928.334851:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1786960928.334858:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1786960928.335841:0:15140:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1786960928.335849:0:15140:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1786960928.336269:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1786960928.336299:0:15140:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1786960928.336307:0:15140:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786960928.349717:0:15140:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786960928.349754:0:15140:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1786960928.349759:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786960928.349760:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786960928.349762:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960928.349763:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960928.349764:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960928.349765:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960928.349766:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786960928.349768:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960928.349769:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786960928.349772:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1786960928.349775:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786960928.349776:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786960928.349777:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960928.349778:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960928.349779:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960928.349780:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960928.349781:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786960928.349782:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960928.349783:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786960928.349807:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786960928.349826:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786960928.349904:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960928.349963:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b6ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.352318:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789056 00000100:00100000:0.0:1786960928.352330:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789056 00000100:00100000:0.0:1786960928.352394:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786960928.352404:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:15140:x1873763967789056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786960928.352437:0:14449:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1786960928.352440:0:14449:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1786960928.352445:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1786960928.363081:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:15140:x1873763967789056:12345-0@lo:253:mount.lustre.0 Request processed in 10668us (13166us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.363096:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786960928.363240:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789056:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786960928.363256:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1786960928.363259:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786960928.363261:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960928.363263:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960928.363264:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960928.363266:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960928.363267:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960928.363268:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960928.363269:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960928.363271:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786960928.363289:0:15140:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9766520b1800 from lustre-OST0000 10000000:01000000:0.0:1786960928.363314:0:15140:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1786960928.363317:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1786960928.363324:0:15140:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97667a6e8000 local copy 00010000:00010000:0.0:1786960928.363334:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960928.363558:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960928.363595:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.363676:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960928.367930:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789184 00000100:00100000:3.0:1786960928.367959:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789184 00000100:00100000:3.0:1786960928.368023:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786960928.368032:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:15140:x1873763967789184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960928.368561:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:15140:x1873763967789184:12345-0@lo:501:mount.lustre.0 Request processed in 528us (4963us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786960928.368570:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786960928.370617:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789184:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1786960928.370661:0:15140:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1786960928.370895:0:15140:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1786960928.370905:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.370916:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960928.370943:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9766520b1800 10000000:01000000:0.0:1786960928.370949:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1786960928.370953:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97667a6e8000 10000000:01000000:0.0:1786960928.370956:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1786960928.370959:0:15140:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97667a6e8000 from 1 10000000:01000000:0.0:1786960928.370962:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1786960928.370994:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.371002:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.371011:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960928.371030:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786960928.371082:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.371129:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960928.371632:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789312 00000100:00100000:3.0:1786960928.371640:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789312 00000100:00100000:3.0:1786960928.371682:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786960928.371689:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+12:15140:x1873763967789312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960928.371702:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960928.371717:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682045e00/0x1808d16e4c980639 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980632 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.371740:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682045e00/0x1808d16e4c980639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980632 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.371749:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682045e00/0x1808d16e4c980639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980632 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.371758:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682045e00, rc 0) 00000100:00100000:3.0:1786960928.371795:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+13:15140:x1873763967789312:12345-0@lo:101:mount.lustre.0 Request processed in 106us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.371801:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786960928.372031:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786960928.372045:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980639 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.372062:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980639 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960928.372080:0:15140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1786960928.372098:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980639 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.372105:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976677926800/0x1808d16e4c980632 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980639 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786960928.372112:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1786960928.372116:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786960928.372121:0:15140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1786960928.372124:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1786960928.372140:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.372148:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.372156:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960928.372172:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789440:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786960928.372238:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.372263:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960928.372472:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789440 00000100:00100000:3.0:1786960928.372478:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789440 00000100:00100000:3.0:1786960928.372509:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786960928.372516:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+13:15140:x1873763967789440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960928.372532:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960928.372540:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976682044a00/0x1808d16e4c980647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980640 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.372555:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976682044a00/0x1808d16e4c980647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980640 expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.372562:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976682044a00/0x1808d16e4c980647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980640 expref: 14 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960928.372569:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976682044a00, rc 0) 00000100:00100000:3.0:1786960928.372604:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789440:12345-0@lo:101:mount.lustre.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.372610:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1786960928.372772:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789440:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786960928.372783:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980647 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.372796:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980647 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786960928.374737:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1786960928.376244:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786960928.378580:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1786960928.378666:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1786960928.378696:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1786960928.378762:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1786960928.378795:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1786960928.379177:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1786960928.379330:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1786960928.379339:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1786960928.379435:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960928.379709:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.379758:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960928.379845:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789568 00000100:00100000:1.0:1786960928.379853:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789568 00000100:00100000:1.0:1786960928.379910:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786960928.379919:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960928.380290:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789568:12345-0@lo:501:mount.lustre.0 Request processed in 372us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960928.380298:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786960928.380514:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960928.380552:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789696:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786960928.380592:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.380623:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960928.380681:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789696 00000100:00100000:2.0:1786960928.380686:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789696 00000100:00100000:2.0:1786960928.380710:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786960928.380716:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786960928.381029:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789696:12345-0@lo:503:mount.lustre.0 Request processed in 311us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.381036:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786960928.381255:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789696:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786960928.381749:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960928.381817:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789824:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960928.381970:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.382066:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666144b000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960928.384313:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789824 00000100:00100000:3.0:1786960928.384326:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789824 00000100:00100000:3.0:1786960928.384380:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1786960928.384390:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960928.385283:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789824:12345-0@lo:502:mount.lustre.0 Request processed in 892us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.385294:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786960928.391359:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786960928.391722:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1786960928.391780:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1786960928.391808:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1786960928.391850:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1786960928.391884:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1786960928.391915:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1786960928.391963:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1786960928.392002:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1786960928.392035:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1786960928.392080:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1786960928.392117:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1786960928.392166:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1786960928.394060:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960928.394144:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.394236:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960928.394314:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967789952 00000100:00100000:2.0:1786960928.394322:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967789952 00000100:00100000:2.0:1786960928.394381:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786960928.394391:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786960928.394624:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967789952:12345-0@lo:502:mount.lustre.0 Request processed in 234us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.394631:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786960928.394850:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967789952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786960928.394954:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1786960928.394970:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1786960928.397172:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786960928.397183:0:15154:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1786960928.397216:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960928.397227:0:15154:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1786960928.397234:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786960928.397247:0:15154:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97664e7f4d40) 00000020:00000080:1.0:1786960928.397270:0:15154:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786960928.397276:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786960928.397357:0:15154:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766520b1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1786960928.397365:0:15154:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786960928.397373:0:15154:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1808d16e4c980655 00010000:00010000:1.0:1786960928.404340:0:15154:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1786960928.405097:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1786960928.407671:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1786960928.411631:0:15154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1786960928.411645:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960928.411652:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411655:0:15154:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1786960928.411659:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786960928.411661:0:15154:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1786960928.411663:0:15154:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960928.411664:0:15154:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786960928.411665:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786960928.411668:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411669:0:15154:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786960928.411672:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960928.411682:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411684:0:15154:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960928.411687:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960928.411689:0:15154:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786960928.411692:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960928.411694:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411695:0:15154:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786960928.411698:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960928.411700:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411701:0:15154:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786960928.411705:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786960928.411765:0:15154:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960928.411768:0:15154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960928.411770:0:15154:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786960928.411773:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1786960928.411993:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1786960928.412025:0:15140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786960928.412048:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980647 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412067:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976677927600/0x1808d16e4c980640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980647 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960928.412076:0:15140:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766520b1800 from 1 10000000:01000000:1.0:1786960928.412079:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960928.412113:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412121:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412131:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960928.412153:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790080:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786960928.412244:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.412282:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790080 00000100:00100000:1.0:1786960928.412289:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790080 00000100:00100000:1.0:1786960928.412327:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786960928.412336:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+14:15140:x1873763967790080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960928.412348:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960928.412360:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c98065c expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412383:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c98065c expref: 15 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412393:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98065c expref: 15 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412409:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93e00, rc 0) 00000100:00100000:1.0:1786960928.412444:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790080:12345-0@lo:101:mount.lustre.0 Request processed in 109us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960928.412463:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786960928.412507:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786960928.412528:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790080:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960928.412541:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.412549:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960928.413066:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1786960928.413615:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960928.413828:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1786960928.413867:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1786960928.413923:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1786960928.413930:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1786960928.413986:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960928.414034:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.414058:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960928.414306:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790208 00000100:00100000:3.0:1786960928.414313:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790208 00000100:00100000:3.0:1786960928.414354:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786960928.414362:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960928.414569:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790208:12345-0@lo:501:mount.lustre.0 Request processed in 207us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.414585:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1786960928.420610:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960928.420672:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790336:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960928.420754:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.420802:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643eb2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.421550:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790336 00000100:00100000:0.0:1786960928.421559:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790336 00000100:00100000:0.0:1786960928.421613:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786960928.421621:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960928.422324:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786960928.424625:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790336:12345-0@lo:503:mount.lustre.0 Request processed in 200us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.424643:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:1.0:1786960928.425705:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786960928.425803:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960928.426346:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.428055:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766596e39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.431941:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790464 00000100:00100000:0.0:1786960928.431956:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790464 00000100:00100000:1.0:1786960928.432081:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786960928.432092:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960928.432406:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790464:12345-0@lo:502:mount.lustre.0 Request processed in 315us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960928.432415:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1786960928.432708:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786960928.433012:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1786960928.433063:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1786960928.433113:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1786960928.433150:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1786960928.433243:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1786960928.433295:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1786960928.433331:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1786960928.433362:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1786960928.433400:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960928.433871:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960928.433959:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976651590300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.437600:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790592 00000100:00100000:0.0:1786960928.437613:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790592 00000100:00100000:0.0:1786960928.437663:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786960928.437671:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960928.438115:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790592:12345-0@lo:502:mount.lustre.0 Request processed in 443us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.438123:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786960928.438254:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790592:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786960928.438418:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1786960928.438434:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1786960928.439583:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960928.439599:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439602:0:15158:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786960928.439608:0:15158:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766520b1800 00000020:00000080:0.0:1786960928.439610:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786960928.439618:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960928.439620:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439621:0:15158:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1786960928.439623:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960928.439625:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439626:0:15158:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786960928.439629:0:15158:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766520b1800 00000020:00000080:0.0:1786960928.439631:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786960928.439699:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960928.439703:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439705:0:15158:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1786960928.439707:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786960928.439710:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439711:0:15158:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786960928.439715:0:15158:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9766520b1800 00000020:00000080:0.0:1786960928.439717:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786960928.439753:0:15158:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786960928.439757:0:15158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786960928.439758:0:15158:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786960928.439761:0:15158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1786960928.449292:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1786960928.449334:0:15140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960928.449363:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.449377:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960928.449456:0:15140:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1786960928.449460:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9766520b1800 10000000:01000000:1.0:1786960928.449464:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9766520b1800 10000000:01000000:1.0:1786960928.449468:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786960928.449474:0:15140:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9766520b1800 from 1 10000000:01000000:1.0:1786960928.449476:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786960928.449512:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.449531:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.449557:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960928.449587:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786960928.449656:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.449698:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960928.451599:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790720 00000100:00100000:2.0:1786960928.451611:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790720 00000100:00100000:2.0:1786960928.451658:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1786960928.451668:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967790720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960928.451684:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960928.451701:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5e200/0x1808d16e4c980671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c98066a expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.451728:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5e200/0x1808d16e4c980671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c98066a expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.451740:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5e200/0x1808d16e4c980671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98066a expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.451751:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e200, rc 0) 00000100:00100000:2.0:1786960928.451847:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967790720:12345-0@lo:101:mount.lustre.0 Request processed in 180us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.451864:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786960928.460356:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960928.460388:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980671 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960928.460401:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980671 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960928.461082:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1786960928.461416:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960928.461687:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1786960928.461726:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1786960928.461752:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1786960928.461788:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1786960928.461816:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1786960928.461852:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1786960928.461879:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1786960928.461904:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1786960928.461939:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1786960928.461966:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1786960928.461992:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1786960928.462027:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1786960928.462069:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1786960928.462103:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1786960928.462161:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1786960928.462239:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1786960928.462275:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1786960928.462321:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1786960928.462356:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1786960928.462388:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1786960928.462434:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1786960928.462469:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1786960928.462501:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1786960928.462547:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1786960928.462581:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1786960928.462615:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1786960928.462664:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1786960928.462699:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1786960928.462782:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1786960928.462790:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1786960928.462884:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960928.462950:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.463001:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.463319:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790848 00000100:00100000:0.0:1786960928.463326:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790848 00000100:00100000:0.0:1786960928.463374:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786960928.463381:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967790848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960928.463607:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967790848:12345-0@lo:501:mount.lustre.0 Request processed in 226us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.463614:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1786960928.471650:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960928.471713:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960928.471785:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.476683:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.485606:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967790976 00000100:00100000:0.0:1786960928.485626:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967790976 00000100:00100000:0.0:1786960928.485703:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786960928.485712:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967790976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786960928.486103:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967790976:12345-0@lo:503:mount.lustre.0 Request processed in 391us (14316us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.486111:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786960928.486243:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967790976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786960928.486782:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786960928.486877:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960928.486926:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.486960:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.488579:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791104 00000100:00100000:0.0:1786960928.488592:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791104 00000100:00100000:0.0:1786960928.488644:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786960928.488654:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967791104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960928.488919:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967791104:12345-0@lo:502:mount.lustre.0 Request processed in 265us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.488926:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786960928.490960:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786960928.491302:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1786960928.491359:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1786960928.491394:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1786960928.491439:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1786960928.491491:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1786960928.491553:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1786960928.491591:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1786960928.491625:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1786960928.491673:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1786960928.491711:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1786960928.491743:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1786960928.491798:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1786960928.491853:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1786960928.491881:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1786960928.491937:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1786960928.491977:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1786960928.492009:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1786960928.492051:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1786960928.492084:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1786960928.492118:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1786960928.492164:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1786960928.492239:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1786960928.492272:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1786960928.492311:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1786960928.492339:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1786960928.492365:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1786960928.492401:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1786960928.492430:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1786960928.492481:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1786960928.492544:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1786960928.492578:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1786960928.492621:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1786960928.492654:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1786960928.492701:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1786960928.492731:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1786960928.492768:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1786960928.492795:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1786960928.492821:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1786960928.492858:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1786960928.492885:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1786960928.492933:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960928.493008:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960928.493035:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1786960928.493917:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791232 00000100:00100000:0.0:1786960928.493927:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791232 00000100:00100000:0.0:1786960928.493978:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786960928.493987:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967791232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960928.494248:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967791232:12345-0@lo:502:mount.lustre.0 Request processed in 261us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960928.494256:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786960928.499879:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786960928.500031:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1786960928.500048:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1786960928.517860:0:15163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1786960928.517884:0:15163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97667be519c0) 00000020:00000080:3.0:1786960928.517906:0:15163:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1786960928.518054:0:15163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766520b1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786960928.518059:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9766520b1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1786960928.518061:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766520b1800 3 00010000:00080000:3.0:1786960928.518089:0:15163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97667bdcb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960928.519703:0:15163:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1786960928.519805:0:15163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1786960928.519842:0:15163:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786960928.519853:0:15163:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1808d16e4c98067f 00000100:00080000:3.0:1786960928.519865:0:15163:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960928.519877:0:15163:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97667bdcb000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960928.519913:0:15163:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace4e00 x1873763967791360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786960928.519970:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967791360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786960928.520037:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960928.520105:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791360 00000100:00100000:3.0:1786960928.520111:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791360 00000100:00100000:3.0:1786960928.520138:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960928.520145:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1873763967791360:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1786960928.520166:0:14459:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1786960928.520214:0:14459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1808d16e4c980686 00000004:00100000:3.0:1786960928.520239:0:14459:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786960928.520270:0:14459:0:(import.c:65:import_set_state_nolock()) ffff97667bdcf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960928.520317:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1873763967791360:12345-0@lo:38:llog_process_th.0 Request processed in 171us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.520324:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1786960928.520365:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97667ace4e00 x1873763967791360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960928.520374:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786960928.520382:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1786960928.520388:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786960928.520392:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786960928.520394:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667bdcb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786960928.520399:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1873763967791360:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1786960928.520417:0:15163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786960928.520445:0:14045:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960928.520448:0:14045:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786960928.520451:0:14045:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960928.520455:0:14045:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786960928.520494:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967791488:0@lo:400:kworker.0 00000100:00100000:3.0:1786960928.520520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960928.520554:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791488 00000100:00100000:3.0:1786960928.520558:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791488 00000100:00100000:3.0:1786960928.520583:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960928.520589:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967791488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960928.520624:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967791488:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960928.520630:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786960928.520653:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97667ace4e00 x1873763967791488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960928.520663:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967791488:0@lo:400:kworker.0 00000040:00080000:0.0:1786960928.532476:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1786960928.532535:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1786960928.532557:0:15140:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786960928.532577:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980671 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.532589:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976642e92e00/0x1808d16e4c98066a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980671 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1786960928.532647:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1786960928.532649:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960928.532650:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960928.532652:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960928.532653:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960928.532654:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960928.532656:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960928.532658:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960928.532659:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786960928.532662:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1786960928.532664:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786960928.532666:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1786960928.532667:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960928.532668:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960928.532669:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960928.532670:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960928.532671:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960928.532672:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960928.532673:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1786960928.532698:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1786960928.532720:0:15140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786960928.532801:0:15140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.532834:0:15140:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646334f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960928.533017:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791616 00000100:00100000:1.0:1786960928.533024:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791616 00000100:00100000:1.0:1786960928.533079:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786960928.533089:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15140:x1873763967791616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786960928.533120:0:14451:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786960928.533133:0:14451:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786960928.594791:0:14451:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786960928.594813:0:14451:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1786960928.595145:0:14473:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786960928.595151:0:14473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786960928.595174:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.595228:0:14473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 16 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.595238:0:14473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.595293:0:14473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 16 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960928.595307:0:14473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 16 pid: 14451 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960928.595321:0:14473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967791744:0@lo:104: 00000100:00100000:0.0:1786960928.595380:0:14473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960928.595416:0:14473:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665552af00 going to sleep for 11 seconds 00000100:00100000:2.0:1786960928.595723:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791744 00000100:00100000:2.0:1786960928.595731:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791744 00000100:00100000:2.0:1786960928.595770:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960928.595780:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967791744:12345-0@lo:104: 00010000:00010000:2.0:1786960928.595792:0:14441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.595866:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960928.595872:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967791744:12345-0@lo:104: Request processed in 94us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.595878:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1786960928.595898:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960928.595904:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.595911:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960928.595914:0:14446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.595922:0:14446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960928.595928:0:14446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960928.595934:0:14446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786960928.595961:0:14446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.595978:0:14446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960928.596000:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596006:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976682045a00/0x1808d16e4c9805f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c9805fa expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596021:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960928.596023:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960928.596025:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960928.596047:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967791872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960928.596073:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960928.596132:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967791872 00000100:00100000:2.0:1786960928.596137:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967791872 00010000:00010000:2.0:1786960928.596153:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 17 pid: 14451 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960928.596173:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960928.596179:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:3285:x1873763967791872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960928.596211:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960928.596228:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 17 pid: 14451 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596239:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 17 pid: 14451 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596255:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596272:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786960928.596286:0:14444:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004447155s 00010000:00010000:2.0:1786960928.596291:0:14444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596298:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596305:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596311:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596317:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960928.596320:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596327:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596336:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596344:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960928.596376:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:3285:x1873763967791872:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.596383:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960928.596429:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967791872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960928.596468:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682044800/0x1808d16e4c9805fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c9805f3 expref: 16 pid: 14451 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960928.596479:0:14473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967791744:0@lo:104: 00010000:00010000:2.0:1786960928.596495:0:14473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596502:0:14473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596508:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960928.596514:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976677926200/0x1808d16e4c98068d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960928.614317:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:15140:x1873763967791616:12345-0@lo:253:mount.lustre.0 Request processed in 81220us (81505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960928.614333:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786960928.614455:0:15140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15140:1873763967791616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786960928.614471:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786960928.614474:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786960928.614476:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786960928.614477:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786960928.614479:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786960928.614480:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786960928.614496:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786960928.614497:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786960928.614499:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786960928.614500:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786960928.614515:0:15140:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1786960928.623158:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960928.623561:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960928.623722:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960928.624350:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786960928.625063:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786960928.625325:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1786960928.627037:0:15140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1786960928.693933:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1786960928.729574:0:15140:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1786960928.729585:0:15140:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1786960928.729614:0:15140:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1786960928.729664:0:15140:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1786960928.729681:0:15140:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1786960928.729699:0:15140:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1786960929.717724:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786960930.488981:0:14454:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786960930.488988:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9766818d0000 from 7 10000000:01000000:0.0:1786960930.488993:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786960930.489090:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960930.489103:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960930.489114:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960930.489141:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967792000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786960930.489277:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960930.489328:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e771840 going to sleep for 11 seconds 00000100:00100000:1.0:1786960930.490009:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792000 00000100:00100000:1.0:1786960930.490018:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792000 00000100:00100000:1.0:1786960930.491089:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1786960930.491104:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+15:14454:x1873763967792000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960930.491122:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960930.491141:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980694 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960930.491168:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980694 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960930.491178:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980694 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960930.491217:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93c00, rc 0) 00000100:00100000:1.0:1786960930.491290:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:14454:x1873763967792000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960930.491298:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786960930.494687:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967792000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960930.494714:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960930.494726:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960930.494818:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967792128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786960930.494903:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960930.504451:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff976646639480 going to sleep for 11 seconds 00000100:00100000:0.0:1786960930.504488:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792128 00000100:00100000:0.0:1786960930.504499:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792128 00000100:00100000:0.0:1786960930.504570:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786960930.504580:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:14454:x1873763967792128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786960930.504606:0:14452:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786960930.504627:0:14452:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786960930.504630:0:14452:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1786960930.504760:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:14454:x1873763967792128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (9856us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960930.504768:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786960930.506005:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967792128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786960930.506086:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786960930.506097:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960930.506108:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960930.743287:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960931.771293:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960932.788335:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786960933.690149:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786960933.690156:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1786960933.690159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786960933.690162:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1786960933.691862:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967792256:0@lo:400:kworker.0 00000100:00100000:1.0:1786960933.692328:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960933.694781:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792256 00000100:00100000:2.0:1786960933.694822:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792256 00000100:00100000:1.0:1786960933.697430:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967792384:0@lo:400:kworker.0 00000100:00100000:1.0:1786960933.697528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960933.697569:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786960933.697576:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967792512:0@lo:400:kworker.0 00000100:00100000:1.0:1786960933.697600:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960933.698528:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786960933.698539:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3286:x1873763967792256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960933.699031:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3286:x1873763967792256:12345-0@lo:400:kworker.0 Request processed in 79us (6290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960933.699042:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1786960933.699991:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792384 00000100:00100000:3.0:1786960933.700001:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792384 00000100:00100000:3.0:1786960933.700042:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792512 00000100:00100000:3.0:1786960933.700045:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792512 00000100:00100000:3.0:1786960933.700077:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960933.700084:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967792384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960933.700144:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1873763967792384:12345-0@lo:400:kworker.0 Request processed in 61us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960933.700151:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960933.700163:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960933.700169:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967792512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960933.700228:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967792512:12345-0@lo:400:kworker.0 Request processed in 59us (2627us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960933.700234:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1786960933.700272:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960933.700429:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967792256:0@lo:400:kworker.0 00010000:00080000:1.0:1786960933.700466:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766779d8e00 x1873763967792512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960933.700478:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967792512:0@lo:400:kworker.0 00010000:00080000:1.0:1786960933.700489:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766779dbb80 x1873763967792384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960933.700497:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1873763967792384:0@lo:400:kworker.0 00010000:00010000:3.0:1786960933.812354:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786960934.820667:0:15506:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1786960934.837081:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960935.860808:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786960936.767952:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786960936.890585:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960937.908630:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786960938.807732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960938.807741:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786960938.807745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960938.807748:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786960938.807792:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960938.807839:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967792896:0@lo:400:kworker.0 00000100:00100000:3.0:1786960938.807935:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960938.808023:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792896 00000100:00100000:3.0:1786960938.808033:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792896 00000100:00100000:3.0:1786960938.808101:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960938.808112:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967792896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960938.808234:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967792896:12345-0@lo:400:kworker.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960938.808243:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1786960938.808269:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1786960938.808307:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667ace4700 x1873763967792896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960938.808323:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967792896:0@lo:400:kworker.0 00000100:00100000:1.0:1786960938.809779:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967792640:0@lo:400:kworker.0 00000100:00100000:1.0:1786960938.809869:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960938.809932:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960938.809963:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967792768:0@lo:400:kworker.0 00000100:00100000:1.0:1786960938.809995:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960938.810271:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792768 00000100:00100000:0.0:1786960938.810281:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792768 00000100:00100000:0.0:1786960938.810344:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786960938.810354:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967792768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960938.810421:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967792768:12345-0@lo:400:kworker.0 Request processed in 68us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960938.810428:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1786960938.810479:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667ace7b80 x1873763967792768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960938.810493:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967792768:0@lo:400:kworker.0 00000100:00100000:2.0:1786960938.810968:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967792640 00000100:00100000:2.0:1786960938.810976:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967792640 00000100:00100000:2.0:1786960938.811026:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786960938.811035:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3285:x1873763967792640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960938.811117:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3285:x1873763967792640:12345-0@lo:400:kworker.0 Request processed in 71us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960938.811124:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786960938.812019:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967792640:0@lo:400:kworker.0 00010000:00010000:0.0:1786960938.939294:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960939.773356:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960924/real 1786960924] req@ffff97667ace4380 x1873763967788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960939 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960939.773467:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97667ace4380 x1873763967788544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960939 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960939.773479:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786960924/real 1786960924] req@ffff97667ace6d80 x1873763967788416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960939 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786960939.773492:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97667ace6d80 x1873763967788416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786960939 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786960939.774011:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786960939.774040:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786960939.774046:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967788544:0@lo:8:kworker.0 00000100:00080000:1.0:1786960939.774053:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786960939.774059:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1786960939.774062:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967788416:0@lo:8:kworker.0 00000100:00100000:3.0:1786960939.774388:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967793024:0@lo:400:kworker.0 00000100:00100000:3.0:1786960939.774456:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960939.774551:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793024 00000100:00100000:1.0:1786960939.774560:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793024 00000100:00100000:1.0:1786960939.774606:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786960939.774613:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3288:x1873763967793024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786960939.774776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786960939.774781:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1786960939.774784:0:8:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786960939.774789:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:2.0:1786960939.774793:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786960939.774798:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97667a86c800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960939.774821:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766816e0000 x1873763967793152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786960939.774855:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786960939.774858:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1786960939.774860:0:8:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786960939.774863:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:2.0:1786960939.774866:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1786960939.774869:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97666b709800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1786960939.774882:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766816e3800 x1873763967793280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786960939.774934:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967793152:0@lo:8:kworker.0 00000100:00100000:2.0:1786960939.774987:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960939.775019:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967793280:0@lo:8:kworker.0 00000100:00100000:2.0:1786960939.775041:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960939.775070:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967793408:0@lo:400:kworker.0 00000100:00100000:2.0:1786960939.775248:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960939.775272:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960939.775278:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967793536:0@lo:400:kworker.0 00000100:00100000:2.0:1786960939.775305:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960939.775341:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793408 00000100:00100000:2.0:1786960939.775346:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793408 00000100:00100000:2.0:1786960939.775438:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793536 00000100:00100000:2.0:1786960939.775442:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793536 00000100:00100000:2.0:1786960939.775462:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960939.775469:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967793408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960939.775570:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967793408:12345-0@lo:400:kworker.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960939.775586:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960939.775602:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786960939.775608:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967793536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960939.775638:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967793536:12345-0@lo:400:kworker.0 Request processed in 32us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960939.775644:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1786960939.775683:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766816e1500 x1873763967793536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960939.775696:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967793536:0@lo:400:kworker.0 00010000:00080000:2.0:1786960939.775708:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766816e0380 x1873763967793408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960939.775716:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967793408:0@lo:400:kworker.0 00000100:00100000:2.0:1786960939.777864:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793152 00000100:00100000:2.0:1786960939.777878:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793152 00000100:00100000:2.0:1786960939.777911:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793280 00000100:00100000:2.0:1786960939.777915:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793280 00000100:00100000:2.0:1786960939.777931:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960939.777938:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967793152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1786960939.777968:0:15142:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:2.0:1786960939.778005:0:15142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c9806a2 00002000:00100000:2.0:1786960939.778020:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9766772e7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1786960939.778025:0:15142:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1786960939.778027:0:15142:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786960939.778407:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786960939.778445:0:15142:0:(import.c:65:import_set_state_nolock()) ffff9766772e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960939.778545:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1873763967793152:12345-0@lo:8:kworker.0 Request processed in 605us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960939.778553:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960939.778571:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960939.778576:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967793280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1786960939.778587:0:15142:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786960939.778615:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967793280:12345-0@lo:8:kworker.0 Request processed in 38us (3573us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786960939.778621:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1786960939.778667:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766816e0000 x1873763967793152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786960959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960939.778678:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786960939.778686:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1786960939.778714:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1786960939.778719:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1786960939.778721:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97667a86c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1786960939.778735:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1786960939.778740:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967793152:0@lo:8:kworker.0 00000100:00080000:2.0:1786960939.778757:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786960939.778762:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1786960939.778765:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967793280:0@lo:8:kworker.0 00000100:00100000:1.0:1786960939.783261:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3288:x1873763967793024:12345-0@lo:400:kworker.0 Request processed in 8639us (8795us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960939.783277:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786960939.783495:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967793024:0@lo:400:kworker.0 00000004:00080000:0.0:1786960939.784334:0:14480:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1786960939.784481:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967793664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786960939.784575:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960939.785166:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14480:1873763967793792:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1786960939.785248:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960939.785272:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565300 going to sleep for 11 seconds 00000004:00080000:0.0:1786960939.785288:0:14479:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786960939.785825:0:14479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421812637584ns, next at 0ns, rc = 0 00000100:00100000:3.0:1786960939.785950:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793792 00000100:00100000:3.0:1786960939.785959:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793792 00000100:00100000:3.0:1786960939.786014:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786960939.786024:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14480:x1873763967793792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1786960939.789412:0:15142:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1786960939.789424:0:15142:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1786960939.789430:0:15142:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:2.0:1786960939.790591:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793664 00000100:00100000:2.0:1786960939.790604:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793664 00000100:00100000:2.0:1786960939.790677:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786960939.790688:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1873763967793664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960939.790733:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960939.790831:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1873763967793664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (6255us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960939.790838:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786960939.790887:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9766816cad80 x1873763967793664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960939.790908:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967793664:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786960939.796317:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1786960939.808747:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.808759:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808783:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.808788:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.808794:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808814:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808825:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808833:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808853:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.808867:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.808873:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808881:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682044800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.808886:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808895:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808925:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808933:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000605cfeb5/0x1808d16e4c9806a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.808951:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.808954:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.808955:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.809465:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.809471:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809480:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.809484:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.809489:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809497:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809505:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809512:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809541:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.809551:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.809555:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809562:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682045a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.809565:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809572:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809584:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809591:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e7935eb/0x1808d16e4c9806b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.809603:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.809605:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.809606:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.809997:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.810004:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810013:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.810019:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.810024:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810032:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810040:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810046:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810060:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.810069:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.810074:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810080:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.810084:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810091:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810102:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810122:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f36fc03/0x1808d16e4c9806b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.810136:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.810138:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.810139:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.813303:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.813313:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.813328:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.813333:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.813338:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.813352:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.813361:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.813369:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.813500:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786960939.816550:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.816569:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.816585:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.816590:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.816595:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.816608:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.816619:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.816626:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.816707:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786960939.816715:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.816723:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.816727:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.816736:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.816757:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.816765:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b0f777a/0x1808d16e4c9806be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.816855:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960939.816862:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.816868:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960939.816871:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.816879:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.816891:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.816899:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960939.816901:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960939.816903:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.816960:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786960939.816965:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072f2737d/0x1808d16e4c9806c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.817467:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.817703:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.817709:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.817720:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.817724:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.817736:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.817746:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.817754:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.817760:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.817828:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786960939.818280:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.818286:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.818295:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.818298:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.818302:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.818311:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.818319:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.818337:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.818956:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786960939.818964:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.818974:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960939.818978:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.818987:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819009:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819017:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fd763e1/0x1808d16e4c9806cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819034:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960939.819038:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819045:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960939.819048:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819056:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819066:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960939.819072:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960939.819074:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960939.819076:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.820752:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786960939.820765:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b90ac1f9/0x1808d16e4c9806d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.820815:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.821449:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.821457:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821469:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.821474:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.821481:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821495:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821505:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821603:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821635:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.821646:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.821651:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821659:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.821663:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821671:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821687:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821695:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0e95d47/0x1808d16e4c9806da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.821709:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.821711:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.821713:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.822859:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.822868:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822879:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.822889:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.822893:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822905:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822913:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822921:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822940:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.822951:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.822956:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822964:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.822968:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822976:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.822988:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823021:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000490acba0/0x1808d16e4c9806e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823037:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.823038:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.823040:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.823505:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.823511:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823520:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.823523:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.823527:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823536:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823545:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823551:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823566:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.823575:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.823584:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823591:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.823594:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823602:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823614:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823621:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079dcbb03/0x1808d16e4c9806e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.823634:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.823636:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.823637:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.824012:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.824019:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824027:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.824031:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.824035:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824057:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824065:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824072:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824086:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.824095:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.824099:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824106:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.824110:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824116:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824127:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.824134:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053cde7c2/0x1808d16e4c9806ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.825334:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.825337:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.825339:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.832357:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.832430:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832449:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.832454:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.832461:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832475:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832487:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832495:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832517:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.832533:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.832538:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832566:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682168c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.832571:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832580:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832598:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832605:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f99205b/0x1808d16e4c9806f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.832630:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.832632:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.832634:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.833255:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.833262:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833273:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.833276:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.833280:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833290:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833306:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833313:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833329:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.833339:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.833343:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833351:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976682169000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.833354:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.833361:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.835484:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.835498:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca17528/0x1808d16e4c9806fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.835520:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.835534:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.835536:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.836039:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.836046:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836059:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.836063:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.836071:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836083:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836093:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836101:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836121:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.836131:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.836135:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836155:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ae00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.836159:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836180:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836212:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836220:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c980704 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.836235:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.836236:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.836238:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.838693:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.838704:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838720:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.838725:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.838730:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838743:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838753:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838767:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838784:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.838797:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.838803:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838812:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.838816:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838824:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838840:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838848:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c98070b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.838866:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.838868:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.838870:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.843631:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.843656:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.843674:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.843679:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.843686:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.843701:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.843712:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.843720:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.843750:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786960939.843791:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960939.843798:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.843807:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960939.843812:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.843821:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.843841:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.843848:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5af7295/0x1808d16e4c980712 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.843867:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960939.843875:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960939.843877:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.847170:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.847200:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.847216:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.847221:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.847227:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.847240:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.847257:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.847264:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.847286:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786960939.847660:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960939.847668:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.847678:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169bc00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960939.847683:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.847693:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.847711:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.847718:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9ae80fa/0x1808d16e4c980719 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960939.847737:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960939.847739:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960939.847740:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.850102:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.850114:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850129:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.850133:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.850139:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850163:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850173:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850180:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850229:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.850241:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.850246:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850254:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.850258:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850266:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850283:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850291:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c980720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.850309:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.850311:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.850313:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.851119:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.851126:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.851137:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.851159:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.851164:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.851176:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.851237:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.851247:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.851268:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960939.852493:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960939.852502:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.852527:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.852531:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.852540:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.852558:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.852565:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b1dd5cc/0x1808d16e4c980727 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.852585:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.852587:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.852590:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.853060:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.853068:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853078:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.853083:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.853089:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853100:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853108:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853122:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853138:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960939.853158:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960939.853163:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853170:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960939.853173:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853180:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853215:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853222:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef41a80/0x1808d16e4c98072e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.853234:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.853236:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960939.853238:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.857930:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.857948:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.857965:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.857969:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.857976:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.857990:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.858000:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.858008:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.858023:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960939.858480:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960939.858488:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.858497:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.858501:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.858510:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.858534:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.858541:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031f25dc3/0x1808d16e4c980735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.858559:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.858561:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.858562:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960939.860293:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.860303:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860317:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.860321:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.860327:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860339:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860356:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860362:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860389:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786960939.860793:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.860799:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860808:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.860812:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.860816:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860825:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860833:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860840:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.860862:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786960939.861297:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.861303:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.861311:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.861314:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.861318:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.861326:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.861334:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.861341:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.861349:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786960939.862393:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.862401:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862413:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.862422:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.862427:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862439:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862447:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862455:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862466:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1786960939.862969:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.862976:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.862985:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.862989:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.862993:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.863004:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.863012:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.863025:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.863035:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1786960939.863532:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1786960939.863541:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863550:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ae00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.863554:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863564:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863582:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863589:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dabed0ed/0x1808d16e4c98073c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863621:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1786960939.863624:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863633:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.863636:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863644:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863655:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863664:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f0d1ea9/0x1808d16e4c980743 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863677:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1786960939.863680:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863687:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.863691:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863711:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863722:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863728:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b328f2b7/0x1808d16e4c98074a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863741:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786960939.863744:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863750:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.863752:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863759:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863770:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863778:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f2f662/0x1808d16e4c980751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863803:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960939.863807:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863813:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.863816:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863823:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863832:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863839:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab8860a3/0x1808d16e4c980758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.863851:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.863852:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.863854:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.863933:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786960939.865833:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1786960939.866171:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960939.866180:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.866223:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1786960939.866228:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960939.866234:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.866247:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.866258:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.866266:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960939.866284:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1786960939.866563:0:15142:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1786960939.866651:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14480:x1873763967793792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 80625us (81399us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960939.866669:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786960939.866780:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14480:1873763967793792:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1786960939.866797:0:14480:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1786960939.866838:0:14480:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14480:1873763967793920:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1786960939.866880:0:14480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960939.866918:0:14480:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565300 going to sleep for 11 seconds 00000100:00100000:0.0:1786960939.866941:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967793920 00000100:00100000:0.0:1786960939.866948:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967793920 00000100:00100000:0.0:1786960939.866990:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960939.866999:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14480:x1873763967793920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786960939.867036:0:15143:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1786960939.867319:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960939.867326:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.867336:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960939.867340:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.867349:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.867367:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.868019:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb5e214c/0x1808d16e4c98075f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960939.868040:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.868042:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960939.868044:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960939.874387:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14480:x1873763967793920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7382us (7499us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786960939.874400:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786960939.875246:0:14480:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14480:1873763967793920:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1786960939.875262:0:14480:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1786960939.956465:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960940.980689:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960942.007338:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786960942.728071:0:15857:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786960942.728075:0:15857:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1786960942.728241:0:15857:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9766772e3800 00000020:01000004:2.0:1786960942.728255:0:15857:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1786960942.728268:0:15857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1786960942.728295:0:15857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff976652363380) 00000020:00000080:2.0:1786960942.728318:0:15857:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786960942.757180:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786960942.757859:0:15857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786960942.760343:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786960942.760759:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1786960942.761001:0:15857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786960942.762423:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 647: rc = 0 00100000:10000000:3.0:1786960942.762595:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 647: rc = 0 00100000:10000000:3.0:1786960942.762746:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 647: rc = 0 00100000:10000000:3.0:1786960942.763364:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 267: rc = 0 00100000:10000000:3.0:1786960942.763702:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 267: rc = 0 00100000:10000000:3.0:1786960942.763970:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 267: rc = 0 00100000:10000000:3.0:1786960942.764281:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 267: rc = 0 00100000:10000000:3.0:1786960942.764530:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 267: rc = 0 00100000:10000000:3.0:1786960942.765717:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 267: rc = 0 00000020:00000080:3.0:1786960942.766539:0:15857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1786960942.766551:0:15857:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786960942.766563:0:15857:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1808d16e4c98076d 00000020:01000004:3.0:1786960942.766571:0:15857:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1786960942.766594:0:15857:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786960942.766597:0:15857:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786960942.766603:0:15857:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1786960942.766623:0:15857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1786960942.766627:0:15857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1786960942.786105:0:15857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786960942.786167:0:15857:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1786960942.786172:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786960942.786178:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786960942.786179:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960942.786180:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960942.786181:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960942.786182:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960942.786184:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786960942.786557:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960942.786558:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960942.786562:0:15857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1786960942.786564:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786960942.786565:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786960942.786566:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786960942.786567:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786960942.786568:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786960942.786569:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786960942.786570:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786960942.786571:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786960942.786572:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786960942.786600:0:15857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1786960942.786621:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786960942.786692:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.786822:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960942.788924:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794048 00000100:00100000:2.0:1786960942.788937:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794048 00000100:00100000:2.0:1786960942.789052:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786960942.789062:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15857:x1873763967794048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1786960942.789098:0:14452:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1786960942.789101:0:14452:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1786960942.789105:0:14452:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1786960942.812887:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15857:x1873763967794048:12345-0@lo:253:mount.lustre.0 Request processed in 23817us (26186us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.812904:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1786960942.816596:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786960942.816616:0:15857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786960942.816619:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786960942.816621:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786960942.816623:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786960942.816624:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786960942.816625:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786960942.816627:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786960942.816628:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786960942.816629:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786960942.816631:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786960942.816657:0:15857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9766772e3800 from lustre-OST0001 10000000:01000000:0.0:1786960942.816685:0:15857:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786960942.816689:0:15857:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786960942.816706:0:15857:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97667a6e8000 local copy 00010000:00010000:0.0:1786960942.816718:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960942.816963:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960942.817018:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960942.817054:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.817234:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794176 00000100:00100000:1.0:1786960942.817242:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794176 00000100:00100000:1.0:1786960942.817293:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786960942.817302:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15857:x1873763967794176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960942.817490:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15857:x1873763967794176:12345-0@lo:501:mount.lustre.0 Request processed in 188us (471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786960942.817498:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786960942.817672:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794176:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786960942.817691:0:15857:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786960942.817848:0:15857:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786960942.817856:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960942.817866:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5ea00/0x1808d16e4c98051a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980521 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786960942.817901:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9766772e3800 10000000:01000000:3.0:1786960942.817906:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786960942.817911:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786960942.817913:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786960942.817917:0:15857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1786960942.817920:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1786960942.817945:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960942.817954:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960942.817964:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960942.817980:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786960942.818009:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.818045:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960942.818181:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794304 00000100:00100000:2.0:1786960942.818219:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794304 00000100:00100000:2.0:1786960942.818245:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786960942.818252:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:15857:x1873763967794304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960942.818261:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960942.818275:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5e400/0x1808d16e4c98077b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980774 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.818295:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5e400/0x1808d16e4c98077b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980774 expref: 17 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.818306:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5e400/0x1808d16e4c98077b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980774 expref: 17 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.818315:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e400, rc 0) 00000100:00100000:2.0:1786960942.818373:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794304:12345-0@lo:101:mount.lustre.0 Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960942.818380:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786960942.819476:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786960942.819494:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98077b expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960942.819506:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98077b expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786960942.820289:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1786960942.823259:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786960942.823557:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1786960942.823610:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1786960942.823646:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1786960942.824152:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1786960942.824231:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1786960942.824268:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1786960942.824919:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1786960942.824932:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1786960942.825040:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960942.825107:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.825167:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561000 going to sleep for 11 seconds 00000100:00100000:2.0:1786960942.825503:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794432 00000100:00100000:2.0:1786960942.825511:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794432 00000100:00100000:2.0:1786960942.825571:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786960942.825580:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786960942.825983:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794432:12345-0@lo:501:mount.lustre.0 Request processed in 403us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960942.825991:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786960942.826243:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960942.826289:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786960942.826329:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.826364:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561000 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.827390:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794560 00000100:00100000:1.0:1786960942.827400:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794560 00000100:00100000:1.0:1786960942.827456:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786960942.827465:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960942.828159:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794560:12345-0@lo:503:mount.lustre.0 Request processed in 692us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960942.828169:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786960942.828300:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786960942.829072:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786960942.829158:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960942.829243:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960942.829282:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565780 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.829500:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794688 00000100:00100000:1.0:1786960942.829506:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794688 00000100:00100000:1.0:1786960942.829548:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1786960942.829556:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960942.830643:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794688:12345-0@lo:502:mount.lustre.0 Request processed in 1082us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960942.830653:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786960942.830955:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786960942.831667:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1786960942.831806:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1786960942.831845:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1786960942.831900:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1786960942.831939:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1786960942.831973:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1786960942.832021:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1786960942.832060:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1786960942.832109:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1786960942.832163:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960942.832262:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960942.832294:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e565780 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.832489:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794816 00000100:00100000:1.0:1786960942.832497:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794816 00000100:00100000:1.0:1786960942.832545:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786960942.832554:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960942.832770:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794816:12345-0@lo:502:mount.lustre.0 Request processed in 216us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960942.832784:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786960942.832956:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786960942.833037:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1786960942.833052:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1786960942.834983:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786960942.834995:0:15859:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1786960942.835001:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786960942.835004:0:15859:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1786960942.835009:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786960942.835023:0:15859:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97667be53380) 00000020:00000080:3.0:1786960942.835051:0:15859:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1786960942.835056:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786960942.835114:0:15859:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766772e3800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1786960942.835134:0:15859:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786960942.835141:0:15859:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1808d16e4c980789 00010000:00010000:2.0:1786960942.847851:0:15859:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1786960942.857559:0:15859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1786960942.866524:0:15859:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1786960942.874866:0:15859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1786960942.874880:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960942.874887:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960942.874890:0:15859:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1786960942.874893:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960942.874896:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960942.874898:0:15859:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786960942.874901:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786960942.874903:0:15859:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1786960942.874905:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960942.874907:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960942.874908:0:15859:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1786960942.874910:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786960942.874912:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960942.874913:0:15859:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1786960942.874916:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1786960942.874975:0:15859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786960942.874978:0:15859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786960942.874980:0:15859:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786960942.874983:0:15859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1786960942.887455:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1786960942.887500:0:15857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786960942.887521:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98077b expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887536:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169b400/0x1808d16e4c980774 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98077b expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960942.887547:0:15857:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e3800 from 1 10000000:01000000:1.0:1786960942.887550:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960942.887591:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887598:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887610:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960942.887636:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786960942.887704:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960942.887757:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967794944 00000100:00100000:1.0:1786960942.887764:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967794944 00000100:00100000:1.0:1786960942.887810:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786960942.887817:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:15857:x1873763967794944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960942.887835:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960942.887849:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980790 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887886:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887897:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.887904:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e92600, rc 0) 00000100:00100000:1.0:1786960942.887947:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967794944:12345-0@lo:101:mount.lustre.0 Request processed in 130us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960942.887954:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786960942.888002:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643da0240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.888025:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967794944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960942.888039:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.888048:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786960942.889794:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1786960942.892154:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786960942.893850:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1786960942.893908:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1786960942.893972:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1786960942.893980:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1786960942.894079:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960942.894157:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960942.894227:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643da0240 going to sleep for 11 seconds 00000100:00100000:0.0:1786960942.894694:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795072 00000100:00100000:0.0:1786960942.894702:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795072 00000100:00100000:0.0:1786960942.894748:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786960942.894759:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786960942.895031:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795072:12345-0@lo:501:mount.lustre.0 Request processed in 274us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960942.895038:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786960942.896242:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786960942.896293:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786960942.896765:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960942.896810:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643da0240 going to sleep for 11 seconds 00000100:00100000:2.0:1786960942.896867:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795200 00000100:00100000:2.0:1786960942.896874:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795200 00000100:00100000:2.0:1786960942.896960:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786960942.896971:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786960942.897285:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795200:12345-0@lo:503:mount.lustre.0 Request processed in 314us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960942.897294:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1786960942.901556:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786960942.902434:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786960942.902512:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960942.902579:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.911489:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795328 00000100:00100000:3.0:1786960942.911519:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795328 00000100:00100000:3.0:1786960942.911571:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1786960942.911580:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960942.911835:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795328:12345-0@lo:502:mount.lustre.0 Request processed in 255us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.911843:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1786960942.912144:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643da0240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.912169:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786960942.912637:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1786960942.912689:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1786960942.912738:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1786960942.912775:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1786960942.912809:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1786960942.912856:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1786960942.912891:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1786960942.912925:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1786960942.912963:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786960942.913014:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960942.913097:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff976643da0240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960942.914570:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795456 00000100:00100000:3.0:1786960942.914581:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795456 00000100:00100000:3.0:1786960942.914680:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786960942.914691:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960942.916625:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795456:12345-0@lo:502:mount.lustre.0 Request processed in 1928us (3602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.916638:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786960942.916744:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786960942.916896:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1786960942.916911:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1786960942.918921:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960942.918934:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.918942:0:15863:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1786960942.918950:0:15863:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766772e3800 00000020:00000080:1.0:1786960942.918952:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786960942.918960:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960942.918963:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.918964:0:15863:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1786960942.918967:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960942.918970:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.918972:0:15863:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786960942.918975:0:15863:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9766772e3800 00000020:00000080:1.0:1786960942.918977:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786960942.919074:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960942.919078:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.919080:0:15863:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1786960942.919082:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786960942.919085:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.919086:0:15863:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1786960942.919090:0:15863:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9766772e3800 00000020:00000080:1.0:1786960942.919092:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1786960942.924487:0:15863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786960942.924500:0:15863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786960942.924503:0:15863:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786960942.924507:0:15863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1786960942.933804:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1786960942.933852:0:15857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786960942.944285:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.944306:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960942.944390:0:15857:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786960942.944394:0:15857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9766772e3800 10000000:01000000:2.0:1786960942.944397:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9766772e3800 10000000:01000000:2.0:1786960942.944401:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786960942.944407:0:15857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9766772e3800 from 1 10000000:01000000:2.0:1786960942.944410:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786960942.944446:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.944454:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.944465:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960942.944490:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786960942.944560:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960942.944620:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960942.950503:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795584 00000100:00100000:1.0:1786960942.950518:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795584 00000100:00100000:1.0:1786960942.950581:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786960942.950592:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967795584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786960942.950608:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960942.950626:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976642e93600/0x1808d16e4c9807a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c98079e expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.950652:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976642e93600/0x1808d16e4c9807a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c98079e expref: 19 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.950671:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976642e93600/0x1808d16e4c9807a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98079e expref: 19 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960942.950679:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976642e93600, rc 0) 00000100:00100000:1.0:1786960942.950760:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795584:12345-0@lo:101:mount.lustre.0 Request processed in 171us (6200us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960942.950767:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786960942.951850:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786960942.951874:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807a5 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960942.951888:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9807a5 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786960942.954534:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1786960942.954920:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960942.955230:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1786960942.955279:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1786960942.955320:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1786960942.955377:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1786960942.955420:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1786960942.955469:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1786960942.955525:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1786960942.955560:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1786960942.955619:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1786960942.955670:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1786960942.955715:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1786960942.955767:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1786960942.955802:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1786960942.955835:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1786960942.955880:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1786960942.955920:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1786960942.955957:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1786960942.956007:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1786960942.956044:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1786960942.956077:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1786960942.958507:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1786960942.958610:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1786960942.958647:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1786960942.958719:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1786960942.958756:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1786960942.958808:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1786960942.958858:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1786960942.958894:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1786960942.958929:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1786960942.958977:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1786960942.959014:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1786960942.959048:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1786960942.959081:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1786960942.959142:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1786960942.959180:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1786960942.959255:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1786960942.959292:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1786960942.961572:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1786960942.961593:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1786960942.961695:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786960942.961764:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960942.961826:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960942.961930:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795712 00000100:00100000:3.0:1786960942.961938:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795712 00000100:00100000:3.0:1786960942.961991:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786960942.962000:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786960942.962288:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795712:12345-0@lo:501:mount.lustre.0 Request processed in 288us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.962296:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1786960942.962541:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786960942.962578:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786960942.962620:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960942.962654:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960942.962767:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795840 00000100:00100000:3.0:1786960942.962772:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795840 00000100:00100000:3.0:1786960942.962806:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1786960942.962813:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795840:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786960942.962950:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795840:12345-0@lo:503:mount.lustre.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.962967:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786960942.963608:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1786960942.964112:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786960942.964214:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786960942.964265:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960942.964302:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97668141b240 going to sleep for 11 seconds 00000100:00100000:3.0:1786960942.965863:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967795968 00000100:00100000:3.0:1786960942.965873:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967795968 00000100:00100000:3.0:1786960942.965962:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786960942.965972:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960942.966266:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967795968:12345-0@lo:502:mount.lustre.0 Request processed in 295us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960942.966275:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1786960942.970918:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967795968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786960942.980007:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1786960942.980141:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1786960942.980182:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1786960942.980468:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1786960942.980940:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1786960942.981019:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1786960942.981052:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1786960942.981078:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1786960942.981118:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1786960942.981173:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1786960942.981456:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1786960942.981511:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1786960942.981617:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1786960942.981653:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1786960942.981698:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1786960942.981735:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1786960942.981768:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1786960942.981815:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1786960942.981847:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1786960942.981876:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1786960942.981919:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1786960942.981952:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1786960942.981991:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1786960942.982037:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1786960942.982072:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1786960942.982103:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1786960942.982178:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1786960942.982602:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1786960942.982645:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1786960942.982699:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1786960942.982738:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1786960942.982769:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1786960942.982799:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1786960942.982861:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1786960942.982896:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1786960942.982941:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1786960942.982980:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1786960942.983017:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1786960942.983064:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1786960942.983101:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1786960942.983969:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967796096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786960942.984048:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960942.984087:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766614d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1786960942.989272:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796096 00000100:00100000:0.0:1786960942.989290:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796096 00000100:00100000:0.0:1786960942.989354:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786960942.989365:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967796096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786960942.989671:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967796096:12345-0@lo:502:mount.lustre.0 Request processed in 306us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960942.989681:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786960942.990366:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967796096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786960942.990488:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1786960942.990508:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1786960942.998150:0:15868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1786960942.998169:0:15868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97667be54d40) 00000020:00000080:3.0:1786960942.998225:0:15868:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1786960942.998711:0:15868:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9766772e3800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786960942.998716:0:15868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9766772e3800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1786960942.998719:0:15868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9766772e3800 3 00010000:00080000:3.0:1786960942.998766:0:15868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff976541183000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1786960943.004313:0:15868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1786960943.004435:0:15868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1786960943.004477:0:15868:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786960943.004493:0:15868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1808d16e4c9807b3 00000100:00080000:3.0:1786960943.004504:0:15868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786960943.004511:0:15868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff976541183000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960943.004548:0:15868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace5f80 x1873763967796224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786960943.004577:0:15868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786960943.004638:0:14045:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786960943.004644:0:14045:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1786960943.004647:0:14045:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1786960943.004651:0:14045:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00100000:1.0:1786960943.004656:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967796352:0@lo:400:kworker.0 00000100:00080000:3.0:1786960943.004657:0:14045:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1786960943.004665:0:14045:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97666b709800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1786960943.004682:0:14045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97667ace6a00 x1873763967796480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786960943.004731:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960943.004756:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796352 00000100:00100000:3.0:1786960943.004764:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796352 00000100:00100000:3.0:1786960943.004811:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960943.004821:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1873763967796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960943.004884:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1873763967796352:12345-0@lo:400:kworker.0 Request processed in 64us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960943.004891:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786960943.004907:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967796352:0@lo:400:kworker.0 00000100:00100000:0.0:1786960943.006243:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967796224:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786960943.006311:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960943.006351:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967796480:0@lo:8:kworker.0 00000100:00100000:0.0:1786960943.006378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960943.006700:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967796608:0@lo:400:kworker.0 00000100:00100000:2.0:1786960943.006733:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960943.006778:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960943.006785:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967796736:0@lo:400:kworker.0 00000100:00100000:2.0:1786960943.006809:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786960943.006840:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786960943.006853:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796224 00000100:00100000:2.0:1786960943.006859:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796224 00000100:00100000:2.0:1786960943.006882:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796608 00000100:00100000:2.0:1786960943.006885:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796608 00000100:00100000:2.0:1786960943.006907:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796736 00000100:00100000:2.0:1786960943.006919:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796736 00000100:00100000:2.0:1786960943.006952:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786960943.006960:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967796608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960943.007012:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967796608:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960943.007019:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786960943.007037:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960943.007043:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967796736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960943.007072:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1873763967796736:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960943.007078:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786960943.007090:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960943.007094:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1873763967796224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786960943.007116:0:14458:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:2.0:1786960943.007160:0:14458:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1808d16e4c9807ba 00000004:00100000:2.0:1786960943.007216:0:14458:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786960943.007251:0:14458:0:(import.c:65:import_set_state_nolock()) ffff976541b85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960943.007296:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1873763967796224:12345-0@lo:38:llog_process_th.0 Request processed in 201us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960943.007303:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1786960943.007343:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667ace7100 x1873763967796736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960943.007370:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1873763967796736:0@lo:400:kworker.0 00010000:00080000:2.0:1786960943.007385:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667ace6300 x1873763967796608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960943.007393:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967796608:0@lo:400:kworker.0 00010000:00080000:2.0:1786960943.007438:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97667ace5f80 x1873763967796224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786960953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786960943.007445:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786960943.007451:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1786960943.007458:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1786960943.007462:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1786960943.007464:0:3284:0:(import.c:65:import_set_state_nolock()) ffff976541183000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1786960943.007469:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1873763967796224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786960943.008549:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796480 00000100:00100000:1.0:1786960943.008560:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796480 00000100:00100000:1.0:1786960943.008608:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786960943.008616:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1873763967796480:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1786960943.008693:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1873763967796480:12345-0@lo:8:kworker.0 Request processed in 77us (2314us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786960943.008701:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960943.009129:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786960943.009137:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786960943.009142:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1786960943.009146:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967796480:0@lo:8:kworker.0 00000100:00080000:3.0:1786960943.009206:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1786960943.009477:0:15868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1786960943.010075:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1786960943.010108:0:15857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786960943.010139:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807a5 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.010151:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5f600/0x1808d16e4c98079e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807a5 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1786960943.010232:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1786960943.010235:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786960943.010236:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960943.010238:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960943.010240:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960943.010241:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960943.010243:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786960943.010245:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960943.010247:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786960943.010251:0:15857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1786960943.010254:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786960943.010255:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786960943.010256:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960943.010257:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960943.010259:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960943.010259:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960943.010261:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786960943.010262:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960943.010263:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1786960943.010286:0:15857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1786960943.010305:0:15857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967796864:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786960943.010370:0:15857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960943.010411:0:15857:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5650c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960943.010473:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796864 00000100:00100000:0.0:1786960943.010480:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796864 00000100:00100000:0.0:1786960943.010530:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786960943.010539:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:15857:x1873763967796864:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786960943.010570:0:14449:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1786960943.010585:0:14449:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1786960943.029537:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1786960943.061315:0:14449:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786960943.061329:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1786960943.061376:0:14473:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1786960943.061380:0:14473:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1786960943.061410:0:14473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061441:0:14473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980694 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061449:0:14473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061487:0:14473:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061500:0:14473:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 19 pid: 14449 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960943.061515:0:14473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967796992:0@lo:104: 00000100:00100000:2.0:1786960943.061576:0:14473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960943.061628:0:14473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766453dd180 going to sleep for 11 seconds 00000100:00100000:2.0:1786960943.061654:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967796992 00000100:00100000:2.0:1786960943.061661:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967796992 00000100:00100000:2.0:1786960943.061705:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960943.061714:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967796992:12345-0@lo:104: 00010000:00010000:2.0:1786960943.061726:0:14440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061777:0:14440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960943.061783:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:14473:x1873763967796992:12345-0@lo:104: Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960943.061790:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1786960943.061814:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960943.061820:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061834:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926600 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960943.061838:0:14446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061846:0:14446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960943.061852:0:14446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960943.061857:0:14446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786960943.061885:0:14446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061891:0:14446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960943.061911:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061917:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976677926600/0x1808d16e4c980694 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c98069b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.061931:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960943.061933:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960943.061934:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960943.061945:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967797120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960943.061972:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960943.062008:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797120 00000100:00100000:2.0:1786960943.062012:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797120 00010000:00010000:2.0:1786960943.062027:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 20 pid: 14449 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960943.062055:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960943.062062:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+20:3287:x1873763967797120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960943.062073:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960943.062078:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 20 pid: 14449 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062087:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 20 pid: 14449 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062103:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062110:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786960943.062134:0:14444:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004447155s 00010000:00010000:2.0:1786960943.062139:0:14444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062145:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062152:0:14444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062159:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062164:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960943.062174:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062181:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062222:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062232:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960943.062263:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+20:3287:x1873763967797120:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960943.062269:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786960943.062313:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967797120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960943.062351:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976642e93c00/0x1808d16e4c98069b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c980694 expref: 19 pid: 14449 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960943.062359:0:14473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14473:1873763967796992:0@lo:104: 00010000:00010000:2.0:1786960943.062369:0:14473:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062376:0:14473:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062382:0:14473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960943.062387:0:14473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97667ae5e000/0x1808d16e4c9807c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960943.075943:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:15857:x1873763967796864:12345-0@lo:253:mount.lustre.0 Request processed in 65396us (65564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960943.075959:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786960943.076047:0:15857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb0b67db-59e1-45af-922e-ea66d8c1a263:15857:1873763967796864:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786960943.076066:0:15857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1786960943.076069:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786960943.076071:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1786960943.076072:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786960943.076073:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786960943.076074:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786960943.076075:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786960943.076077:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786960943.076078:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786960943.076080:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786960943.076095:0:15857:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1786960943.081557:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960943.081727:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960943.081888:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960943.082045:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1786960943.082254:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1786960943.082464:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786960943.084065:0:15857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786960943.156280:0:15857:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1786960943.156289:0:15857:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1786960943.156317:0:15857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786960943.157813:0:15857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786960943.157835:0:15857:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1786960943.157863:0:15857:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:1.0:1786960944.051543:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1786960944.051561:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1786960944.054309:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960944.955834:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967797248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960944.955903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960944.955979:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797248 00000100:00100000:2.0:1786960944.955986:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797248 00000100:00100000:2.0:1786960944.956027:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960944.956035:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967797248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786960944.956074:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960944.956134:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967797248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960944.956141:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786960944.956543:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1786960944.956565:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967797248:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1786960944.956649:0:14454:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786960944.956653:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9766818d0000 from 8 10000000:01000000:3.0:1786960944.956656:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786960944.956687:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960944.956697:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960944.956707:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960944.956724:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967797376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786960944.956756:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960944.956825:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766468760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960944.956870:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797376 00000100:00100000:0.0:1786960944.956875:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797376 00000100:00100000:0.0:1786960944.956913:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786960944.956921:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667d7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967797376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786960944.956931:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960944.956947:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976677927c00/0x1808d16e4c9807cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c9807c8 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960944.956968:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677927c00/0x1808d16e4c9807cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c9807c8 expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960944.956979:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976677927c00/0x1808d16e4c9807cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c9807c8 expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960944.956999:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927c00, rc 0) 00000100:00100000:0.0:1786960944.957078:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667d7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967797376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960944.957085:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786960944.957936:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967797376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960944.957953:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807cf expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960944.957964:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c9807cf expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960944.958023:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967797504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786960944.958062:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960944.958096:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766468760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960944.958524:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797504 00000100:00100000:0.0:1786960944.958531:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797504 00000100:00100000:0.0:1786960944.958575:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1786960944.958584:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967797504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786960944.958602:0:14449:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786960944.958619:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786960944.958622:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1786960944.958706:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967797504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960944.958713:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786960944.959324:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967797504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786960944.959393:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786960944.959405:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807cf expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960944.959414:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97664169be00/0x1808d16e4c9807c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c9807cf expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960945.082322:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960946.100505:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786960946.996925:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786960947.128504:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960948.021678:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967797632:0@lo:400:kworker.0 00000100:00100000:0.0:1786960948.021843:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960948.025225:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960948.025255:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967797760:0@lo:400:kworker.0 00000100:00100000:0.0:1786960948.025354:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960948.025440:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797632 00000100:00100000:0.0:1786960948.025451:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797632 00000100:00100000:0.0:1786960948.025801:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786960948.025814:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3285:x1873763967797632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960948.025890:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3285:x1873763967797632:12345-0@lo:400:kworker.0 Request processed in 79us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960948.025908:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786960948.025952:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797760 00000100:00100000:0.0:1786960948.025957:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797760 00000100:00100000:0.0:1786960948.026000:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786960948.026007:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967797760:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786960948.027495:0:14045:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786960948.027506:0:14045:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1786960948.027512:0:14045:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786960948.027527:0:14045:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97666b709800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1786960948.027579:0:14045:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9766779da680 x1873763967797888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786960948.027688:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786960948.027930:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967797760:12345-0@lo:400:kworker.0 Request processed in 1920us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960948.027943:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1786960948.027987:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960948.028081:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967798272:0@lo:400:kworker.0 00000100:00100000:1.0:1786960948.028143:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960948.028204:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798272 00000100:00100000:3.0:1786960948.028214:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798272 00000100:00080000:1.0:1786960948.028253:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960948.028274:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786960948.028397:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967798272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960948.028405:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967797760:0@lo:400:kworker.0 00000100:00100000:0.0:1786960948.028420:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb0b67db-59e1-45af-922e-ea66d8c1a263:3285:1873763967797632:0@lo:400:kworker.0 00000100:00100000:3.0:1786960948.028619:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967798272:12345-0@lo:400:kworker.0 Request processed in 335us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960948.028626:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1786960948.028648:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d8700 x1873763967798272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960948.028650:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967798144:0@lo:400:kworker.0 00000100:00100000:1.0:1786960948.028660:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967798272:0@lo:400:kworker.0 00000100:00100000:3.0:1786960948.028676:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960948.028697:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960948.028703:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967798016:0@lo:400:kworker.0 00000100:00100000:3.0:1786960948.028726:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960948.028755:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967797888:0@lo:8:kworker.0 00000100:00100000:3.0:1786960948.028787:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960948.029095:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798144 00000100:00100000:1.0:1786960948.029102:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798144 00000100:00080000:0.0:1786960948.029229:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960948.029243:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798016 00000100:00100000:3.0:1786960948.029247:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798016 00000100:00100000:3.0:1786960948.029271:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960948.029279:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967798144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786960948.029395:0:14459:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1786960948.029397:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967798144:12345-0@lo:400:kworker.0 Request processed in 118us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960948.029405:0:14459:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1786960948.029413:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960948.029687:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960948.029696:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967798016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960948.029729:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967798016:12345-0@lo:400:kworker.0 Request processed in 35us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960948.029734:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786960948.029757:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967797888 00000100:00100000:3.0:1786960948.029762:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967797888 00000100:00100000:3.0:1786960948.029785:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960948.029790:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1873763967797888:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1786960948.029818:0:15142:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1786960948.029852:0:15142:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1808d16e4c9807d6 00002000:00100000:3.0:1786960948.029868:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97667d7dd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113832 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1786960948.029872:0:15142:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1786960948.029876:0:15142:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786960948.030830:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786960948.030867:0:15142:0:(import.c:65:import_set_state_nolock()) ffff97667d7d9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960948.031580:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1873763967797888:12345-0@lo:8:kworker.0 Request processed in 1783us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960948.031595:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1786960948.031665:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779da680 x1873763967797888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786960973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786960948.031685:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786960948.031695:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786960948.031702:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786960948.031713:0:3284:0:(import.c:65:import_set_state_nolock()) ffff97666b709800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786960948.032821:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786960948.032835:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1873763967797888:0@lo:8:kworker.0 00000004:00080000:1.0:1786960948.032858:0:14482:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1786960948.032886:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14482:1873763967798528:0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1786960948.032903:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779db480 x1873763967798016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786960948.032917:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967798016:0@lo:400:kworker.0 00010000:00080000:3.0:1786960948.032950:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779daa00 x1873763967798144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786960964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1786960948.032954:0:14481:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1786960948.032966:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967798144:0@lo:400:kworker.0 00000004:00080000:2.0:1786960948.033870:0:14481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430060680547ns, next at 0ns, rc = 0 00000100:00100000:0.0:1786960948.035272:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967798400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960948.035413:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960948.035457:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766597ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960948.035523:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798528 00000100:00100000:1.0:1786960948.035533:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798528 00000100:00100000:1.0:1786960948.035601:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786960948.035612:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14482:x1873763967798528:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1786960948.037464:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960948.039008:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798400 00000100:00100000:2.0:1786960948.039025:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798400 00000100:00100000:2.0:1786960948.039099:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786960948.039110:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1873763967798400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960948.039146:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960948.039297:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1873763967798400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960948.039305:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1786960948.040439:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1786960948.044465:0:15143:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1786960948.044481:0:15143:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1786960948.044806:0:15143:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:0.0:1786960948.048482:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9766779d8700 x1873763967798400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786960964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786960948.048522:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967798400:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1786960948.059948:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.059962:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.060002:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.060008:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.060027:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.060049:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.060062:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.060071:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.060123:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786960948.060637:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960948.060651:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.060736:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960948.060741:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.060773:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.060800:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.060808:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.060832:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960948.060834:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960948.060836:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.061844:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.061856:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061872:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.061878:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.061884:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061896:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061920:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061928:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061954:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.061971:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.061977:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061985:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.061990:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.061999:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.062183:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.062230:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c9807e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.062260:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.062269:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.062272:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.064246:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.064259:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064277:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.064282:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.064288:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064303:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064799:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064817:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064847:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.064867:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.064876:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064885:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.064891:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064920:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064942:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064951:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.064982:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.064985:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.064987:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.070809:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.070829:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070852:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.070857:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.070865:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070882:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070894:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070913:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070936:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.070954:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.070960:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070969:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.070974:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.070984:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.071003:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.071012:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c9807f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.071820:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.071822:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.071824:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.078094:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.078181:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.078237:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.078242:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.078250:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.078268:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.078282:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.078290:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.078311:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960948.078892:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960948.078904:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.078916:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960948.078922:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.078934:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.078964:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.078973:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c9807f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.079849:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960948.079853:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960948.079856:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.082419:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.083266:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083291:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.083297:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.083305:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083425:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083514:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083523:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083555:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.083574:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.083582:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083590:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.083596:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083607:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083627:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083635:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980800 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.083665:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.083673:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.083676:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.089327:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.089347:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.089370:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.089375:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.089383:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.089399:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.089411:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.089419:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.089651:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786960948.089818:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786960948.089832:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.089847:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:3.0:1786960948.089852:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.089863:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.089889:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.089898:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c980807 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.089937:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960948.089940:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960948.089943:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.092366:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.092385:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092405:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.092411:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.092417:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092795:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092809:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092818:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092841:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.092856:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.092863:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092871:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.092876:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092887:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092905:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092913:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c98080e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.092945:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.092948:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.092951:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.094284:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.094297:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094370:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.094376:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.094382:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094396:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094405:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094412:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094646:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.094664:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.094671:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094810:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.094814:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094823:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094840:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094847:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f973bb67/0x1808d16e4c980815 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.094867:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.094869:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.094870:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.095874:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.095886:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095900:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.095905:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.095910:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095922:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095941:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095949:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095970:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.095984:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.095991:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.095999:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.096004:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.096013:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.096102:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.096165:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6244656/0x1808d16e4c98081c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.096228:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.096239:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.096242:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.098558:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.098572:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.098591:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.098596:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.098603:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.098619:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.098630:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.098638:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.098664:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786960948.098752:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960948.098761:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.098773:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960948.098779:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.098790:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.098878:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.098904:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5df278f/0x1808d16e4c980823 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960948.098942:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960948.098945:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960948.098949:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.099551:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.099561:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099572:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.099577:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.099582:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099603:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099613:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099620:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099638:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.099651:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.099656:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099665:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.099668:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099786:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099802:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099809:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac39229/0x1808d16e4c98082a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.099831:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.099833:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.099835:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.100850:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.100862:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100878:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.100883:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.100889:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100903:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100913:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100922:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100951:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786960948.100970:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786960948.100976:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.100999:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960948.101004:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.101013:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.101105:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.101176:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e05fa1c9/0x1808d16e4c980831 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.101244:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.101247:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.101249:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1786960948.102081:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.102100:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.102357:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.102362:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.102368:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.102382:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.102400:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.102409:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.102425:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.102527:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.102535:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.102543:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e93400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.102547:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.102568:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.102588:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.102597:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.102599:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.102600:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.102638:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab2eeb7f/0x1808d16e4c980838 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960948.103637:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.103648:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.103662:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.103666:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.103671:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.103794:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.103805:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.103826:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.103884:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1786960948.104476:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.104483:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.104494:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.104498:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.104502:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.104512:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.104522:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.104529:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104743:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786960948.104752:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104762:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.104767:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104778:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104797:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104806:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a19dd9ad/0x1808d16e4c98083f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104842:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.104845:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104853:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.104856:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104864:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104876:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.104883:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.104885:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.104887:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.105398:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786960948.105405:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e40ecac/0x1808d16e4c980846 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960948.106296:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.106307:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.106321:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.106325:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.106332:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.106345:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.106356:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.106365:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.106562:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.106572:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.106581:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a6000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.106585:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.106608:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.106626:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.106635:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.106637:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.106639:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.106772:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786960948.106777:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb9a7071/0x1808d16e4c98084d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960948.107650:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786960948.107658:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.107691:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=430s v=(0 0) 00010000:00010000:1.0:1786960948.107696:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960948.107706:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.107719:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.107730:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960948.107738:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.107869:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.107877:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.107886:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.107890:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.107899:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.107912:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.107921:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.107923:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.107925:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786960948.107993:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1786960948.107999:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e10a233d/0x1808d16e4c980854 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.108308:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786960948.109624:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1786960948.110242:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.110251:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.110273:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.110278:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.110285:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.110596:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.110608:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.110616:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.110639:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.110723:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.110731:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.110740:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.110744:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.110753:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.110769:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.110777:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef41a80/0x1808d16e4c98085b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.110793:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.110795:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.110797:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.114600:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.114614:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.114631:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.114636:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.114643:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.115104:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.115133:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.115141:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.115166:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.115213:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.115220:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.115228:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.115232:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.115251:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.115267:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.115286:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb5e214c/0x1808d16e4c980862 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.115305:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.115307:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.115309:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.117634:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.117645:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.117661:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.117666:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.117672:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.117684:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.117694:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.117702:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.117738:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.117814:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.117821:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.117830:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.117833:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.117842:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.117860:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.117880:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab8860a3/0x1808d16e4c980869 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.117899:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.117901:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.117903:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.118320:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.118327:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.118336:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.118339:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.118343:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.118353:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.118361:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.118368:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.118388:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.118415:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.118420:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.118428:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.118432:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.118439:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.118455:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.118462:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f2f662/0x1808d16e4c980870 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.118477:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.118479:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.118481:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.119760:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.119770:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.119783:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.119795:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.119801:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.119813:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.119822:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.119828:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.119890:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786960948.120974:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.120983:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.120995:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.120998:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.121002:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.121013:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.121021:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.121035:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122075:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786960948.122096:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122107:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.122112:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122121:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122145:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122153:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b328f2b7/0x1808d16e4c980877 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122223:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.122227:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122235:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.122238:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122246:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122285:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.122294:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.122296:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.122298:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960948.124972:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786960948.124989:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f0d1ea9/0x1808d16e4c98087e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.125129:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.126349:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.126360:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.126377:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.126383:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.126390:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.126404:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.126415:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.126422:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.126460:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.126491:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.126499:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.126508:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ae00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.126513:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.126523:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.126540:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.126548:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dabed0ed/0x1808d16e4c980885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.126566:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.126568:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.126575:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.128973:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.128986:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.129000:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.129005:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.129010:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.129023:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.129034:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.129041:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.129064:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.129136:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.129143:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.129152:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.129156:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.129165:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.129182:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.129202:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031f25dc3/0x1808d16e4c98088c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.129228:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.129230:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.129232:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.133043:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.133056:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.133073:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.133084:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.133105:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.133122:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.133133:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.133142:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.133170:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.133246:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.133254:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.133263:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169bc00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.133267:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.133304:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.133321:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.133328:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9ae80fa/0x1808d16e4c980893 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.133349:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.133351:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.133353:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786960948.134317:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786960948.134325:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.134336:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1786960948.134340:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960948.134345:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.134355:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.134364:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.134379:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960948.134398:0:15143:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786960948.134444:0:14446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786960948.134451:0:14446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.134460:0:14446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b800 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960948.134463:0:14446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.134472:0:14446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.134485:0:14446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.134505:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b1dd5cc/0x1808d16e4c98089a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960948.134523:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.134525:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786960948.134527:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1786960948.134645:0:15143:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1786960948.134844:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14482:1873763967798528:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786960948.134859:0:14482:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1786960948.134901:0:14482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14482:1873763967798656:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1786960948.134931:0:14482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960948.134977:0:14482:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e771480 going to sleep for 11 seconds 00000100:00100000:3.0:1786960948.134982:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14482:x1873763967798528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 99133us (99330us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960948.134993:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786960948.135027:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798656 00000100:00100000:3.0:1786960948.135033:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798656 00000100:00100000:3.0:1786960948.135095:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786960948.135104:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14482:x1873763967798656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1786960948.135140:0:15144:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1786960948.140422:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14482:x1873763967798656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5311us (5482us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1786960948.140441:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786960948.140500:0:14482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816c8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14482:1873763967798656:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1786960948.140530:0:14482:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1786960948.152448:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786960948.672365:0:7615:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1786960948.672404:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1786960949.173609:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960950.073349:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967798784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960950.073519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960950.076523:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798784 00000100:00100000:0.0:1786960950.076542:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798784 00000100:00100000:0.0:1786960950.076635:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960950.076648:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967798784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960950.076696:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786960950.076925:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960950.078629:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967798784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1970us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960950.078646:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786960950.081219:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967798784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786960950.197700:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786960950.234954:0:16219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1786960951.225372:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960952.246379:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960952.373283:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.373510:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367104 00000100:00100000:2.0:1786960952.373520:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367104 00000100:00100000:2.0:1786960952.373564:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:2.0:1786960952.373573:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2340:x1873763958367104:12345-192.168.203.23@tcp:250:mount.lustre.0 00010000:00080000:2.0:1786960952.373602:0:14452:0:(ldlm_lib.c:1446:target_handle_connect()) MGS: connection from fc7daf30-e2f7-464c-a127-8955fc940cbc@192.168.203.23@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1786960952.373631:0:14452:0:(genops.c:1406:class_connect()) connect: client fc7daf30-e2f7-464c-a127-8955fc940cbc, cookie 0x1808d16e4c9808a1 00000100:00080000:2.0:1786960952.373792:0:14452:0:(import.c:65:import_set_state_nolock()) ffff976541b84000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960952.373861:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+5:2340:x1873763958367104:12345-192.168.203.23@tcp:250:mount.lustre.0 Request processed in 288us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.373869:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 76 00000100:00100000:0.0:1786960952.384766:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.384905:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367232 00000100:00100000:2.0:1786960952.384916:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367232 00000100:00100000:2.0:1786960952.384990:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:2.0:1786960952.385004:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+5:13771:x1873763958367232:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786960952.385028:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960952.385051:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5f200/0x1808d16e4c9808a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c285 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.385105:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5f200/0x1808d16e4c9808a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c285 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.385118:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5f200/0x1808d16e4c9808a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c285 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.385129:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f200, rc 0) 00000100:00100000:2.0:1786960952.385274:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+6:13771:x1873763958367232:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 274us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.385282:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 77 00000100:00100000:1.0:1786960952.394638:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.396843:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367360 00000100:00100000:0.0:1786960952.396857:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367360 00000100:00100000:0.0:1786960952.396920:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:0.0:1786960952.396929:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+6:13771:x1873763958367360:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786960952.397336:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+6:13771:x1873763958367360:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 406us (2711us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786960952.397345:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1786960952.402535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.402645:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367488 00000100:00100000:0.0:1786960952.402656:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367488 00000100:00100000:0.0:1786960952.402713:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:0.0:1786960952.402725:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+6:13771:x1873763958367488:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786960952.402740:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960952.402861:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976677927000/0x1808d16e4c9808af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c28c expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.402892:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677927000/0x1808d16e4c9808af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c28c expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.402903:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976677927000/0x1808d16e4c9808af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c28c expref: 7 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.402913:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927000, rc 0) 00000100:00100000:0.0:1786960952.403026:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a689850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+7:13771:x1873763958367488:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 303us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.403034:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:1.0:1786960952.409842:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.412022:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367616 00000100:00100000:2.0:1786960952.412045:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367616 00000100:00100000:2.0:1786960952.412372:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:2.0:1786960952.412387:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+7:13771:x1873763958367616:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786960952.413029:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13771:x1873763958367616:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 641us (3199us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.413039:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 80 00000100:00100000:1.0:1786960952.419891:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.420083:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367744 00000100:00100000:2.0:1786960952.420098:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367744 00000100:00100000:2.0:1786960952.420179:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:2.0:1786960952.420240:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13771:x1873763958367744:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786960952.423346:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13771:x1873763958367744:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 3139us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.423365:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 81 00000100:00100000:2.0:1786960952.439993:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.440935:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958367872 00000100:00100000:0.0:1786960952.440952:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958367872 00000100:00100000:0.0:1786960952.441065:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:0.0:1786960952.441079:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13790:x1873763958367872:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786960952.441587:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a688450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13790:x1873763958367872:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 507us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.441607:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 82 00000100:00100000:1.0:1786960952.499475:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.500580:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368000 00000100:00100000:0.0:1786960952.500600:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368000 00000100:00100000:0.0:1786960952.500672:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:0.0:1786960952.500683:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13790:x1873763958368000:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786960952.501345:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a68b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13790:x1873763958368000:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 659us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.501356:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 83 00000100:00100000:1.0:1786960952.508179:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.508548:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368128 00000100:00100000:2.0:1786960952.508563:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368128 00000100:00100000:2.0:1786960952.508627:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:2.0:1786960952.508638:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+8:13771:x1873763958368128:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786960952.508662:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960952.508686:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5f000/0x1808d16e4c9808b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c2b6 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.508722:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5f000/0x1808d16e4c9808b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2b6 expref: 9 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.508734:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5f000/0x1808d16e4c9808b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2b6 expref: 9 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960952.508745:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f000, rc 0) 00000100:00100000:2.0:1786960952.508828:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+9:13771:x1873763958368128:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 189us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.508835:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 84 00000100:00100000:2.0:1786960952.512712:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960952.512808:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368256 00000100:00100000:1.0:1786960952.512818:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368256 00000100:00100000:1.0:1786960952.512870:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:1.0:1786960952.512880:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+9:13771:x1873763958368256:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1786960952.512970:0:14449:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1786960952.512996:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1786960952.513001:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1786960952.513004:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1786960952.513007:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1786960952.527462:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+9:13771:x1873763958368256:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 14557us (14732us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.527484:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 85 00000100:00100000:2.0:1786960952.531949:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.532871:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368384 00000100:00100000:0.0:1786960952.532890:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368384 00000100:00100000:0.0:1786960952.532976:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:0.0:1786960952.533006:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+9:13771:x1873763958368384:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786960952.533029:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960952.533055:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c2bd expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.533105:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.533144:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 10 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960952.533157:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677926600, rc 0) 00000100:00100000:0.0:1786960952.533295:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13771:x1873763958368384:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 293us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.533303:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1786960952.536394:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.538675:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368512 00000100:00100000:0.0:1786960952.538697:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368512 00000100:00100000:0.0:1786960952.538798:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:0.0:1786960952.538812:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13771:x1873763958368512:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786960952.539271:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13771:x1873763958368512:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 459us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.539280:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:1.0:1786960952.542647:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.542893:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368640 00000100:00100000:0.0:1786960952.542970:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368640 00000100:00100000:0.0:1786960952.543078:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:0.0:1786960952.543090:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13771:x1873763958368640:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786960952.543522:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13771:x1873763958368640:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 433us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.543530:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1786960952.547517:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.547625:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368768 00000100:00100000:2.0:1786960952.547635:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368768 00000100:00100000:2.0:1786960952.547688:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:2.0:1786960952.547697:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13796:x1873763958368768:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960952.547971:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13796:x1873763958368768:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 273us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960952.547988:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1786960952.555512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.556226:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958368896 00000100:00100000:0.0:1786960952.556246:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958368896 00000100:00100000:0.0:1786960952.556314:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:0.0:1786960952.556324:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13796:x1873763958368896:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786960952.556577:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13796:x1873763958368896:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 253us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.556585:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 90 00000100:00100000:0.0:1786960952.565735:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960952.572375:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369024 00000100:00100000:2.0:1786960952.572390:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369024 00000100:00100000:2.0:1786960952.572509:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1786960952.572517:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1873763958369024:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786960952.572547:0:14457:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 7574538c-a858-46d1-9879-75c3b8cac0cc@192.168.203.23@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1786960952.572593:0:14457:0:(genops.c:1406:class_connect()) connect: client 7574538c-a858-46d1-9879-75c3b8cac0cc, cookie 0x1808d16e4c9808c4 00000004:00100000:2.0:1786960952.572622:0:14457:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1786960952.572628:0:14457:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1786960952.619968:0:14457:0:(import.c:65:import_set_state_nolock()) ffff9765438fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960952.620050:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2340:x1873763958369024:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 47530us (54322us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.620070:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1786960952.626671:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960952.627830:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960952.627969:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369280 00000100:00100000:3.0:1786960952.627994:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369280 00000100:00100000:3.0:1786960952.628073:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369152 00000100:00100000:3.0:1786960952.628076:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369152 00000100:00100000:3.0:1786960952.628099:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960952.628109:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:13771:x1873763958369280:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:3.0:1786960952.628151:0:14458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786960952.628248:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:13771:x1873763958369280:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 140us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960952.628256:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:3.0:1786960952.628274:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1786960952.628282:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+6:0:x1873763958369152:12345-192.168.203.23@tcp:41:mount.lustre.0 00000100:00080000:2.0:1786960952.628388:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1786960952.629008:0:14458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786960952.630140:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+6:0:x1873763958369152:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 1849us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960952.630152:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1786960952.643175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.644038:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369408 00000100:00100000:0.0:1786960952.644050:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369408 00000100:00100000:0.0:1786960952.644126:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1786960952.644137:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+6:13771:x1873763958369408:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1786960952.644258:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+6:13771:x1873763958369408:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 122us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.644266:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:1.0:1786960952.647136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.647229:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369536 00000100:00100000:0.0:1786960952.647239:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369536 00000100:00100000:0.0:1786960952.647287:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1786960952.647294:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1873763958369536:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786960952.647323:0:15142:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 7574538c-a858-46d1-9879-75c3b8cac0cc@192.168.203.23@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1786960952.647352:0:15142:0:(genops.c:1406:class_connect()) connect: client 7574538c-a858-46d1-9879-75c3b8cac0cc, cookie 0x1808d16e4c9808cb 00002000:00100000:0.0:1786960952.647363:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7574538c-a858-46d1-9879-75c3b8cac0cc/ffff9765438fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786960952.647387:0:15142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786960952.647677:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786960952.647888:0:15142:0:(import.c:65:import_set_state_nolock()) ffff9765438fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786960952.647952:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2340:x1873763958369536:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 657us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.647960:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1786960952.659870:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960952.660016:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369664 00000100:00100000:0.0:1786960952.660032:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369664 00000100:00100000:0.0:1786960952.660105:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1786960952.660114:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1873763958369664:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786960952.660146:0:15144:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 7574538c-a858-46d1-9879-75c3b8cac0cc@192.168.203.23@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1786960952.660535:0:15144:0:(genops.c:1406:class_connect()) connect: client 7574538c-a858-46d1-9879-75c3b8cac0cc, cookie 0x1808d16e4c9808d2 00002000:00100000:3.0:1786960952.667153:0:15144:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7574538c-a858-46d1-9879-75c3b8cac0cc/ffff9765438fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786960952.667216:0:15144:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786960952.668735:0:15144:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786960952.668772:0:15144:0:(import.c:65:import_set_state_nolock()) ffff976541182000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786960952.676871:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2340:x1873763958369664:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 16740us (17001us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960952.676889:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1786960952.677218:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960952.679098:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369792 00000100:00100000:3.0:1786960952.679112:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369792 00000100:00100000:3.0:1786960952.679210:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960952.679220:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+6:13771:x1873763958369792:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00080000:1.0:1786960952.682880:0:14460:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3592us 00000004:00200000:0.0:1786960952.720974:0:14460:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1786960952.721173:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+6:13771:x1873763958369792:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 41950us (43951us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960952.721211:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1786960952.940986:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960952.941103:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958369920 00000100:00100000:1.0:1786960952.941112:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958369920 00000100:00100000:1.0:1786960952.941173:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:1.0:1786960952.941183:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:13817:x1873763958369920:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:1.0:1786960952.941225:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960952.941251:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c9808d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c2e7 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941327:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941358:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941372:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960952.941550:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786960952.941555:0:14459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960952.941642:0:14459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941669:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6e00/0x1808d16e4c9808d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2e7 expref: 8 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941687:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2e7 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960952.941696:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:1.0:1786960952.941700:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960952.941703:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7000, rc 0) 00000100:00100000:1.0:1786960952.941776:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+7:13817:x1873763958369920:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 594us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960952.941783:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1786960953.140863:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967799040:0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.140935:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960953.140995:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967799552:0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141021:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960953.141046:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786960953.141062:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967799168:0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141084:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960953.141121:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799040 00000100:00100000:0.0:1786960953.141129:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799040 00000100:00100000:0.0:1786960953.141175:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799168 00000100:00100000:0.0:1786960953.141178:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799168 00000100:00100000:0.0:1786960953.141216:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786960953.141241:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967799040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141305:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967799040:12345-0@lo:400:kworker.0 Request processed in 67us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960953.141313:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786960953.141328:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960953.141335:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967799168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141359:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967799168:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960953.141365:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786960953.141382:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799552 00000100:00100000:0.0:1786960953.141385:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799552 00000100:00100000:0.0:1786960953.141408:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786960953.141414:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967799552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141441:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1873763967799552:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960953.141446:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786960953.141477:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1786960953.141496:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967799168:0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141509:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967799040:0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.141518:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1873763967799552:0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141663:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967798912:0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141701:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960953.141736:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967799424:0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141757:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960953.141777:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960953.141783:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967799296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141804:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960953.141832:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799424 00000100:00100000:3.0:1786960953.141836:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799424 00000100:00100000:3.0:1786960953.141861:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799296 00000100:00100000:3.0:1786960953.141864:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799296 00000100:00100000:3.0:1786960953.141876:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786960953.141883:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967799424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141916:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967799424:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960953.141922:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786960953.141934:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960953.141940:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967799296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141962:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967799296:12345-0@lo:400:kworker.0 Request processed in 23us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960953.141968:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960953.141989:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967799296:0@lo:400:kworker.0 00000100:00100000:3.0:1786960953.141998:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967799424:0@lo:400:kworker.0 00000100:00080000:2.0:1786960953.142226:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786960953.142232:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786960953.142234:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960953.142812:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967799680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960953.142851:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960953.143393:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799680 00000100:00100000:2.0:1786960953.143400:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799680 00000100:00100000:2.0:1786960953.143449:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960953.143457:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967799680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960953.143478:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960953.143550:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967799680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960953.143556:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960953.143638:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967799680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786960953.145130:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967798912 00000100:00100000:0.0:1786960953.145141:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967798912 00000100:00100000:0.0:1786960953.145237:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786960953.145247:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3288:x1873763967798912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960953.145336:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3288:x1873763967798912:12345-0@lo:400:kworker.0 Request processed in 91us (3632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960953.145356:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1786960953.145534:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967798912:0@lo:400:kworker.0 00010000:00010000:3.0:1786960953.268600:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786960953.798562:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7574538c-a858-46d1-9879-75c3b8cac0cc 00000001:00100000:0.0:1786960954.251244:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7574538c-a858-46d1-9879-75c3b8cac0cc 00010000:00010000:3.0:1786960954.292691:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960954.911655:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960954.911810:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370048 00000100:00100000:3.0:1786960954.911823:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370048 00000100:00100000:3.0:1786960954.911931:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960954.911946:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:13869:x1873763958370048:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:3.0:1786960954.912009:0:14458:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1786960954.912142:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:13869:x1873763958370048:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 199us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960954.912151:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:2.0:1786960954.915472:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960954.924383:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960954.924587:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370176 00000100:00100000:0.0:1786960954.924600:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370176 00000100:00080000:2.0:1786960954.924763:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786960954.924848:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1786960954.924862:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7574538c-a858-46d1-9879-75c3b8cac0cc+5:13869:x1873763958370176:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:0.0:1786960954.924917:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786960954.925020:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7574538c-a858-46d1-9879-75c3b8cac0cc+5:13869:x1873763958370176:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 161us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960954.925028:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1786960954.929862:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960954.930016:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370304 00000100:00100000:1.0:1786960954.930031:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370304 00000100:00100000:1.0:1786960954.930274:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1786960954.930286:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7574538c-a858-46d1-9879-75c3b8cac0cc+5:13869:x1873763958370304:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:1.0:1786960954.930347:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960954.930472:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7574538c-a858-46d1-9879-75c3b8cac0cc+5:13869:x1873763958370304:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 187us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960954.930480:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00080000:2.0:1786960954.934089:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786960955.106891:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960955.106980:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370432 00000100:00100000:0.0:1786960955.106994:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370432 00000100:00100000:0.0:1786960955.107082:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:0.0:1786960955.107094:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+10:13899:x1873763958370432:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786960955.107126:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960955.107149:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff976677927a00/0x1808d16e4c9808e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c2ee expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960955.107235:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff976677927a00/0x1808d16e4c9808e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2ee expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960955.107251:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff976677927a00/0x1808d16e4c9808e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2ee expref: 11 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960955.107282:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927a00, rc 0) 00000100:00100000:0.0:1786960955.109325:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958370432:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 2217us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960955.109340:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 92 00000100:00100000:3.0:1786960955.125452:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.128383:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370560 00000100:00100000:2.0:1786960955.128429:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370560 00000100:00100000:2.0:1786960955.128523:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:2.0:1786960955.128536:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958370560:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786960955.130384:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958370560:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 1835us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.130399:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 93 00000100:00100000:3.0:1786960955.144414:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960955.145329:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370688 00000100:00100000:0.0:1786960955.145345:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370688 00000100:00100000:0.0:1786960955.145483:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1786960955.145495:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958370688:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786960955.149249:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958370688:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 370us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960955.149272:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 94 00000100:00100000:0.0:1786960955.162947:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.163146:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370816 00000100:00100000:2.0:1786960955.163159:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370816 00000100:00100000:2.0:1786960955.163277:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:2.0:1786960955.163289:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766520eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13906:x1873763958370816:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960955.164768:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766520eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13906:x1873763958370816:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 1467us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.164785:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 95 00000100:00100000:0.0:1786960955.188904:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786960955.196056:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967799808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786960955.196167:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960955.196585:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799808 00000100:00100000:1.0:1786960955.196598:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799808 00000100:00100000:1.0:1786960955.196692:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786960955.196705:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967799808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960955.196737:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960955.196810:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967799808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.196818:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1786960955.196946:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960955.197055:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967799808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960955.198660:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960955.199759:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958370944 00000100:00100000:0.0:1786960955.199775:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958370944 00000100:00100000:0.0:1786960955.199862:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:0.0:1786960955.199875:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13906:x1873763958370944:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786960955.200307:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13906:x1873763958370944:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 433us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960955.200327:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 96 00000100:00100000:3.0:1786960955.207748:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960955.207992:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371072 00000100:00100000:1.0:1786960955.208006:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371072 00000100:00100000:1.0:1786960955.208136:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:1.0:1786960955.208148:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13899:x1873763958371072:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786960955.208171:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960955.208248:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6600/0x1808d16e4c9808ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c318 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.209132:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6600/0x1808d16e4c9808ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c318 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.209150:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6600/0x1808d16e4c9808ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c318 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.209162:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6600, rc 0) 00000100:00100000:1.0:1786960955.209299:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13899:x1873763958371072:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 1152us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.209329:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 97 00000100:00100000:1.0:1786960955.233556:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.233800:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371200 00000100:00100000:2.0:1786960955.233815:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371200 00000100:00100000:2.0:1786960955.233894:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:2.0:1786960955.233907:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13899:x1873763958371200:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786960955.233946:0:14451:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786960955.233990:0:14451:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786960955.233995:0:14451:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786960955.233999:0:14451:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786960955.234001:0:14451:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1786960955.243747:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13899:x1873763958371200:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 9701us (10065us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.243835:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 98 00000100:00100000:3.0:1786960955.247425:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960955.248342:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371328 00000100:00100000:1.0:1786960955.248363:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371328 00000100:00100000:1.0:1786960955.248475:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:1.0:1786960955.248488:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13899:x1873763958371328:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1786960955.248513:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960955.248540:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c31f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.248579:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.248605:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960955.248616:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a6a00, rc 0) 00000100:00100000:1.0:1786960955.248911:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13899:x1873763958371328:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 423us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.248919:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 99 00000100:00100000:1.0:1786960955.253132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.253245:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371456 00000100:00100000:2.0:1786960955.253258:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371456 00000100:00100000:2.0:1786960955.253344:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:2.0:1786960955.253357:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13899:x1873763958371456:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786960955.254047:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13899:x1873763958371456:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 682us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.254057:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 100 00000100:00100000:3.0:1786960955.259293:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960955.259635:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371584 00000100:00100000:1.0:1786960955.259658:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371584 00000100:00100000:1.0:1786960955.259732:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:1.0:1786960955.259744:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13899:x1873763958371584:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1786960955.260433:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13899:x1873763958371584:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 687us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.260451:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 101 00000100:00100000:3.0:1786960955.268237:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.269159:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371712 00000100:00100000:2.0:1786960955.269174:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371712 00000100:00100000:2.0:1786960955.269292:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:2.0:1786960955.269304:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13913:x1873763958371712:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786960955.271450:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13913:x1873763958371712:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 348us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.271480:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 102 00000100:00100000:0.0:1786960955.287343:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960955.287489:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371840 00000100:00100000:1.0:1786960955.287504:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371840 00000100:00100000:1.0:1786960955.287579:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:1.0:1786960955.287592:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13913:x1873763958371840:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1786960955.288047:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13913:x1873763958371840:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 447us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.288057:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 103 00000100:00100000:3.0:1786960955.298370:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960955.300906:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958371968 00000100:00100000:2.0:1786960955.300926:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958371968 00000100:00100000:2.0:1786960955.301065:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1786960955.301076:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1873763958371968:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786960955.301118:0:14457:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-MDT0000: connection from 87c6625f-b470-4281-b8b5-8effbb0d7a4e@192.168.203.23@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1786960955.301171:0:14457:0:(genops.c:1406:class_connect()) connect: client 87c6625f-b470-4281-b8b5-8effbb0d7a4e, cookie 0x1808d16e4c9808fc 00000004:00100000:2.0:1786960955.301250:0:14457:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786960955.301405:0:14457:0:(import.c:65:import_set_state_nolock()) ffff976541b80800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960955.301511:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2340:x1873763958371968:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 435us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.301520:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1786960955.314433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960955.314485:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960955.314690:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372224 00000100:00100000:1.0:1786960955.314703:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372224 00000100:00100000:1.0:1786960955.314797:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372096 00000100:00100000:1.0:1786960955.314801:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372096 00000100:00100000:1.0:1786960955.314826:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960955.314838:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+7:13899:x1873763958372224:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1786960955.314898:0:14459:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1786960955.314986:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+7:13899:x1873763958372224:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 150us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.314995:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960955.315016:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1786960955.315023:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:0:x1873763958372096:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1786960955.315034:0:14459:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1786960955.315069:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:0:x1873763958372096:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 46us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960955.315077:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00080000:2.0:1786960955.315221:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786960955.317985:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960955.320127:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960955.320283:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372352 00000100:00100000:3.0:1786960955.320297:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372352 00000100:00100000:3.0:1786960955.320379:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1786960955.320392:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:13899:x1873763958372352:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1786960955.320511:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:13899:x1873763958372352:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 122us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960955.320520:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1786960955.323071:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960955.323113:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960955.323173:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960955.323220:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372480 00000100:00100000:0.0:1786960955.323244:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372480 00000100:00100000:0.0:1786960955.323298:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372608 00000100:00100000:0.0:1786960955.323302:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372608 00000100:00100000:0.0:1786960955.323319:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:0.0:1786960955.323328:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1873763958372480:12345-192.168.203.23@tcp:8:mount.lustre.0 00000100:00100000:2.0:1786960955.323361:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372736 00000100:00100000:2.0:1786960955.323365:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372736 00010000:00080000:0.0:1786960955.323367:0:15142:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0000: connection from 87c6625f-b470-4281-b8b5-8effbb0d7a4e@192.168.203.23@tcp t0 exp 0000000000000000 cur 437 last 0 00000100:00100000:2.0:1786960955.323403:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000020:00000080:0.0:1786960955.323405:0:15142:0:(genops.c:1406:class_connect()) connect: client 87c6625f-b470-4281-b8b5-8effbb0d7a4e, cookie 0x1808d16e4c980903 00000100:00100000:2.0:1786960955.323410:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:13899:x1873763958372736:12345-192.168.203.23@tcp:33:mount.lustre.0 00002000:00100000:0.0:1786960955.323419:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 87c6625f-b470-4281-b8b5-8effbb0d7a4e/ffff9765438f8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786960955.323432:0:15142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:2.0:1786960955.323629:0:14461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1786960955.323804:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:13899:x1873763958372736:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 392us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.323811:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00002000:00080000:2.0:1786960955.324156:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786960955.324254:0:15142:0:(import.c:65:import_set_state_nolock()) ffff9766520b7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960955.324297:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2340:x1873763958372480:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 969us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.324305:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1786960955.324326:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1786960955.324331:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1873763958372608:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786960955.324353:0:15142:0:(ldlm_lib.c:1446:target_handle_connect()) lustre-OST0001: connection from 87c6625f-b470-4281-b8b5-8effbb0d7a4e@192.168.203.23@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1786960955.324379:0:15142:0:(genops.c:1406:class_connect()) connect: client 87c6625f-b470-4281-b8b5-8effbb0d7a4e, cookie 0x1808d16e4c98090a 00002000:00100000:2.0:1786960955.324389:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 87c6625f-b470-4281-b8b5-8effbb0d7a4e/ffff976541b15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113832 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786960955.324397:0:15142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786960955.324567:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786960955.324584:0:15142:0:(import.c:65:import_set_state_nolock()) ffff976541b13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786960955.324624:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2340:x1873763958372608:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 277us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960955.324632:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:0.0:1786960955.521783:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960955.521881:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372864 00000100:00100000:3.0:1786960955.521906:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372864 00000100:00100000:3.0:1786960955.521995:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1786960955.522009:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:13934:x1873763958372864:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:3.0:1786960955.522047:0:16120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960955.522079:0:16120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a200/0x1808d16e4c980911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c349 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522165:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522181:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522236:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960955.522518:0:16120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786960955.522531:0:16120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960955.522649:0:16120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522686:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a200/0x1808d16e4c980911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 8 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522707:0:16120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 7 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960955.522718:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:3.0:1786960955.522732:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960955.522737:0:16120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a800, rc 0) 00000100:00100000:3.0:1786960955.522834:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+7:13934:x1873763958372864:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 829us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960955.522843:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000040:00080000:2.0:1786960956.215738:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786960956.346109:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786960957.364622:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786960957.829157:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7574538c-a858-46d1-9879-75c3b8cac0cc 00000001:00100000:3.0:1786960957.829183:0:5833:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 87c6625f-b470-4281-b8b5-8effbb0d7a4e 00000100:00100000:3.0:1786960958.266981:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967799936:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267096:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267164:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967800448:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267220:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267253:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786960958.267259:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967800320:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267330:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800192:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267358:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267378:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1786960958.267382:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800064:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267403:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267422:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967800576:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267451:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960958.267483:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967799936 00000100:00100000:3.0:1786960958.267494:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967799936 00000100:00100000:3.0:1786960958.267554:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786960958.267564:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3288:x1873763967799936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267621:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3288:x1873763967799936:12345-0@lo:400:kworker.0 Request processed in 59us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.267629:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786960958.267666:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800448 00000100:00100000:3.0:1786960958.267669:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800448 00000100:00100000:3.0:1786960958.267703:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800320 00000100:00100000:3.0:1786960958.267705:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800320 00000100:00100000:3.0:1786960958.267715:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800576 00000100:00100000:3.0:1786960958.267716:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800576 00000100:00100000:3.0:1786960958.267730:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960958.267735:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967800448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267766:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967800448:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.267771:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960958.267782:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960958.267788:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967800320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267828:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1873763967800320:12345-0@lo:400:kworker.0 Request processed in 40us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.267835:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786960958.267846:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786960958.267853:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967800576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267880:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1873763967800576:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.267886:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786960958.267908:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800192 00000100:00100000:3.0:1786960958.267911:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800192 00000100:00100000:3.0:1786960958.267936:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800064 00000100:00100000:3.0:1786960958.267939:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800064 00000100:00100000:3.0:1786960958.267955:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960958.267961:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.267989:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800192:12345-0@lo:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.267994:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786960958.268004:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786960958.268010:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268047:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800064:12345-0@lo:400:kworker.0 Request processed in 37us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960958.268053:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1786960958.268073:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960958.268078:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960958.268081:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786960958.268122:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800064:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268143:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1873763967800576:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268151:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800192:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268215:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1873763967800320:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268226:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967799936:0@lo:400:kworker.0 00000100:00100000:3.0:1786960958.268235:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967800448:0@lo:400:kworker.0 00000100:00100000:1.0:1786960958.271208:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786960958.271310:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960958.271375:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800704 00000100:00100000:1.0:1786960958.271383:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800704 00000100:00100000:1.0:1786960958.271442:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786960958.271452:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960958.271501:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960958.271552:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1873763967800704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960958.271560:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786960958.271612:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1873763967800704:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786960958.389470:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786960958.591977:0:16425:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1786960958.836092:0:7615:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 87c6625f-b470-4281-b8b5-8effbb0d7a4e 00000001:00100000:2.0:1786960959.314902:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 87c6625f-b470-4281-b8b5-8effbb0d7a4e 00010000:00010000:3.0:1786960959.412683:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960960.308793:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967800832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786960960.308893:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960960.309051:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967800832 00000100:00100000:1.0:1786960960.309061:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967800832 00000100:00100000:1.0:1786960960.309149:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786960960.309162:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967800832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786960960.309234:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786960960.309291:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967800832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960960.309299:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1786960960.309424:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960960.309480:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967800832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786960960.444407:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960960.666997:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667114:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667132:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667149:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960960.667213:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960960.667344:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373376 00000100:00100000:2.0:1786960960.667358:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373376 00000100:00100000:2.0:1786960960.667507:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373632 00000100:00100000:2.0:1786960960.667512:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373632 00000100:00100000:2.0:1786960960.667530:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373248 00000100:00100000:2.0:1786960960.667533:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373248 00000100:00100000:2.0:1786960960.667545:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373760 00000100:00100000:2.0:1786960960.667547:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373760 00000100:00100000:2.0:1786960960.667564:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1786960960.667575:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958373376:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960960.667668:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958373376:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 94us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960960.667676:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1786960960.667697:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960960.667703:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958373632:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960960.667728:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958373632:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960960.667733:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960960.667743:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960960.667748:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958373248:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960960.667787:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958373248:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960960.667794:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960960.667828:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1786960960.667835:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958373760:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960960.667861:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958373760:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960960.667867:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1786960960.668111:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958372992 00000100:00100000:2.0:1786960960.668117:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958372992 00000100:00100000:2.0:1786960960.668148:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:2.0:1786960960.668155:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958372992:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1786960960.668182:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958372992:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960960.668223:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 105 00000100:00100000:3.0:1786960960.670103:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373120 00000100:00100000:3.0:1786960960.670122:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373120 00000100:00100000:3.0:1786960960.670225:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373504 00000100:00100000:3.0:1786960960.670230:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373504 00000100:00100000:3.0:1786960960.670268:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1786960960.670280:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2344:x1873763958373120:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960960.670431:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:1.0:1786960960.670443:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766779d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958373504:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960960.670480:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958373504:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 41us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960960.670612:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1786960960.670678:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766779db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2344:x1873763958373120:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 399us (3692us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960960.670687:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00080000:3.0:1786960960.670708:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786960960.670713:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960960.670717:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786960961.461358:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786960962.395951:0:16576:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeafb42eb0 20000000:00000080:3.0:1786960962.395969:0:16576:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9765413a9000 uarg=0000000000000000 20000000:01000000:3.0:1786960962.396016:0:16576:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960962.396022:0:16576:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1786960962.396027:0:16576:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1786960962.397321:0:16577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1786960962.397565:0:16576:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1786960962.404498:0:16576:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786960962.404526:0:16576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404544:0:16576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98060f expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404552:0:16576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c98065c expref: 18 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404560:0:16576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404569:0:16576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404576:0:16576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404583:0:16576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404624:0:16576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404638:0:16576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 12 pid: 14449 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.404667:0:16576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967800960:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960962.404774:0:16576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404782:0:16576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.404791:0:16576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801088:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960962.404824:0:16576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404831:0:16576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.404839:0:16576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801216:0@lo:104: 00000100:00100000:3.0:1786960962.404876:0:16576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960962.404917:0:16576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 18 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404925:0:16576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 18 pid: 14452 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.404933:0:16576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801344:0@lo:104: 00000100:00100000:3.0:1786960962.404953:0:16576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786960962.404982:0:16576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.404989:0:16576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 18 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.405019:0:16576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801472:0@lo:104: 00000100:00100000:3.0:1786960962.405044:0:16576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960962.405055:0:16576:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e771300 going to sleep for 11 seconds 00000100:00100000:2.0:1786960962.405137:0:14441:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786960962.405152:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801216 00000100:00100000:2.0:1786960962.405159:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801216 00000100:00100000:2.0:1786960962.405229:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801344 00000100:00100000:2.0:1786960962.405233:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801344 00000100:00100000:2.0:1786960962.405244:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801472 00000100:00100000:2.0:1786960962.405247:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801472 00000100:00100000:2.0:1786960962.405260:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960962.405268:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:16576:x1873763967801216:12345-0@lo:104: 00010000:00010000:2.0:1786960962.405280:0:14441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405345:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786960962.405352:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+5:16576:x1873763967801216:12345-0@lo:104: Request processed in 84us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.405367:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960962.405384:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960962.405389:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+4:16576:x1873763967801344:12345-0@lo:104: 00010000:00010000:2.0:1786960962.405397:0:14441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405431:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786960962.405436:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+4:16576:x1873763967801344:12345-0@lo:104: Request processed in 48us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.405442:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960962.405453:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960962.405459:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976664d06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:16576:x1873763967801472:12345-0@lo:104: 00010000:00010000:2.0:1786960962.405466:0:14441:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405492:0:14441:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786960962.405497:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976664d06050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb0b67db-59e1-45af-922e-ea66d8c1a263+3:16576:x1873763967801472:12345-0@lo:104: Request processed in 38us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.405502:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1786960962.405549:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786960962.405555:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405563:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92a00 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960962.405567:0:14445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405586:0:14445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960962.405594:0:14445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960962.405599:0:14445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786960962.405627:0:14445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405633:0:14445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960962.405652:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405660:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976642e92a00/0x1808d16e4c980790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980797 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405672:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786960962.405676:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405682:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92800 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960962.405684:0:14445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405690:0:14445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960962.405696:0:14445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960962.405707:0:14445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786960962.405721:0:14445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405727:0:14445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960962.405744:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405751:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976642e92800/0x1808d16e4c98065c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980663 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405759:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960962.405762:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405767:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976642e92400 already unused, calling callback (ffffffffc1b5fc20) 10000000:00010000:2.0:1786960962.405770:0:14445:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405776:0:14445:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786960962.405782:0:14445:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786960962.405786:0:14445:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1786960962.405797:0:14445:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405802:0:14445:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786960962.405814:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405820:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff976642e92400/0x1808d16e4c98060f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1808d16e4c980616 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.405832:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960962.405834:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960962.405836:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960962.405842:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960962.405861:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967801600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960962.405891:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960962.405929:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967801856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960962.405952:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960962.405972:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786960962.405978:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967801728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960962.406015:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960962.406042:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801600 00000100:00100000:2.0:1786960962.406046:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801600 00010000:00010000:2.0:1786960962.406064:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 19 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960962.406078:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801856 00000100:00100000:2.0:1786960962.406082:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801856 00010000:00010000:2.0:1786960962.406093:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 20 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960962.406102:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801728 00000100:00100000:2.0:1786960962.406105:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801728 00010000:00010000:2.0:1786960962.406115:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 21 pid: 14452 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960962.406137:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960962.406144:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+21:3288:x1873763967801600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960962.406154:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960962.406161:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 21 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406169:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 21 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406207:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960962.406240:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+21:3288:x1873763967801600:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.406246:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786960962.406260:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960962.406266:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+20:3286:x1873763967801856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960962.406274:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960962.406278:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 20 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406286:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 20 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406296:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960962.406324:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+20:3286:x1873763967801856:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.406330:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786960962.406343:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960962.406357:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674acb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3286:x1873763967801728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786960962.406365:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960962.406370:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 19 pid: 14452 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406379:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 19 pid: 14452 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.406388:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960962.406412:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674acb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3286:x1873763967801728:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.406418:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786960962.406479:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967801600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960962.406506:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967801728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786960962.406515:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb0b67db-59e1-45af-922e-ea66d8c1a263:3286:1873763967801856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786960962.406719:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976642e92600/0x1808d16e4c980797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c980790 expref: 18 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.406731:0:16576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801216:0@lo:104: 00010000:00010000:3.0:1786960962.406738:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976642e93e00/0x1808d16e4c980663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c98065c expref: 17 pid: 14452 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.406745:0:16576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801344:0@lo:104: 00010000:00010000:3.0:1786960962.406753:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976682045000/0x1808d16e4c980616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1808d16e4c98060f expref: 16 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960962.406760:0:16576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801472:0@lo:104: 00000100:00100000:2.0:1786960962.411716:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960962.411944:0:16576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967800960:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960962.411955:0:16576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16576:1873763967801088:192.168.203.23@tcp:104: 00010000:00010000:3.0:1786960962.412003:0:16576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960962.412080:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958373888 00000100:00100000:0.0:1786960962.412087:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958373888 00010000:00010000:0.0:1786960962.412121:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960962.412156:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1786960962.412164:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958373888:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960962.412178:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960962.412183:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960962.412214:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960962.412239:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9766743a6a00/0x1808d16e4c9808f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c31f expref: 13 pid: 14449 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960962.412268:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960962.412323:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:2344:x1873763958373888:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 160us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960962.412331:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:3.0:1786960962.414689:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960962.414773:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374016 00000100:00100000:2.0:1786960962.414782:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374016 00010000:00010000:2.0:1786960962.414819:0:14443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960962.414860:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960962.414872:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:2344:x1873763958374016:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960962.414887:0:14443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960962.414893:0:14443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.414925:0:14443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.414943:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff976677926600/0x1808d16e4c9808bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2bd expref: 12 pid: 14451 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.414959:0:14443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.414967:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.414984:0:14443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415000:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415008:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415015:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415021:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a200 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960962.415025:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415033:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415064:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960962.415076:0:14443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960962.415128:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:2344:x1873763958374016:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 257us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960962.415135:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00010000:00010000:3.0:1786960962.415552:0:16576:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.415561:0:16576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960962.415578:0:16576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97664169a200/0x1808d16e4c98091f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960962.487121:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960963.380518:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967801984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786960963.380588:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.380784:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967802112:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.380815:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.380852:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967802624:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.380880:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.380909:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786960963.380917:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967802496:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.380944:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.381065:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967802240:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.381128:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786960963.381136:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967802368:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381254:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960963.381291:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802112 00000100:00100000:2.0:1786960963.381298:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802112 00000100:00100000:2.0:1786960963.381340:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1786960963.381350:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3288:x1873763967802112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381519:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:3288:x1873763967802112:12345-0@lo:400:kworker.0 Request processed in 170us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960963.381541:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1786960963.381572:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802624 00000100:00100000:2.0:1786960963.381575:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802624 00000100:00100000:2.0:1786960963.381614:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802496 00000100:00100000:2.0:1786960963.381617:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802496 00000100:00100000:2.0:1786960963.381631:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802368 00000100:00100000:2.0:1786960963.381634:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802368 00000100:00100000:2.0:1786960963.381645:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786960963.381650:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967802624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381684:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967802624:12345-0@lo:400:kworker.0 Request processed in 34us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960963.381690:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786960963.381701:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786960963.381707:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967802496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381734:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1873763967802496:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960963.381740:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786960963.381749:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786960963.381755:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967802368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381785:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1873763967802368:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960963.381791:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1786960963.381812:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802240 00000100:00100000:2.0:1786960963.381815:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802240 00000100:00100000:2.0:1786960963.381844:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960963.381853:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967802240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.381902:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967802240:12345-0@lo:400:kworker.0 Request processed in 52us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960963.381910:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786960963.381975:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1873763967802368:0@lo:400:kworker.0 00000100:00100000:1.0:1786960963.382092:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967801984 00000100:00100000:1.0:1786960963.382097:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967801984 00000100:00100000:1.0:1786960963.382138:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786960963.382158:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967801984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786960963.382214:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960963.382327:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967802240:0@lo:400:kworker.0 00000100:00080000:3.0:1786960963.382398:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960963.382403:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960963.382406:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786960963.382569:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967801984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 423us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960963.382576:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786960963.382658:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967801984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960963.382719:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1873763967802496:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.382729:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb0b67db-59e1-45af-922e-ea66d8c1a263:3288:1873763967802112:0@lo:400:kworker.0 00000100:00100000:2.0:1786960963.382739:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967802624:0@lo:400:kworker.0 00010000:00010000:2.0:1786960963.517533:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786960964.150272:0:14454:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786960964.150281:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766772e3800 from 10 10000000:01000000:2.0:1786960964.150287:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786960964.150339:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960964.150351:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960964.150362:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960964.150388:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967802752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.150470:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960964.150542:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665156c480 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.154725:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802752 00000100:00100000:3.0:1786960964.154740:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802752 00000100:00100000:3.0:1786960964.154895:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786960964.154906:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+16:14454:x1873763967802752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.154923:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960964.154942:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169a200/0x1808d16e4c98092d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980926 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.154971:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169a200/0x1808d16e4c98092d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980926 expref: 17 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.154993:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169a200/0x1808d16e4c98092d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980926 expref: 17 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.155003:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a200, rc 0) 00000100:00100000:3.0:1786960964.155075:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967802752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.155082:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786960964.155177:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967802752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.155213:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98092d expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.155224:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98092d expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960964.155292:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967802880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.155326:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960964.155356:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766654cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.155369:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967802880 00000100:00100000:3.0:1786960964.155373:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967802880 00000100:00100000:3.0:1786960964.155397:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1786960964.155404:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967802880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.157214:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967802880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1778us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.157228:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1786960964.165385:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967802880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.165473:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.165547:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960964.165612:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665156cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786960964.167091:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803008 00000100:00100000:1.0:1786960964.167103:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803008 00000100:00100000:1.0:1786960964.167166:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786960964.167175:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967803008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.167428:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967803008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960964.167435:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786960964.168551:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786960964.169976:0:16653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1786960964.170175:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1786960964.170219:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960964.170230:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98092d expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.170240:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff97667ae5f400/0x1808d16e4c980926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98092d expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960964.170260:0:14454:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786960964.170262:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766520b1800 from 10 10000000:01000000:1.0:1786960964.170265:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960964.170297:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.170304:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.170314:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960964.170337:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.170395:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960964.170506:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766466ce540 going to sleep for 11 seconds 00000100:00100000:2.0:1786960964.171533:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803136 00000100:00100000:2.0:1786960964.171543:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803136 00000100:00100000:2.0:1786960964.171730:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1786960964.171751:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+17:14454:x1873763967803136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786960964.171910:0:14451:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960964.171928:0:14451:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97667ae5f800/0x1808d16e4c98093b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980934 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960964.171955:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97667ae5f800/0x1808d16e4c98093b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980934 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960964.171966:0:14451:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97667ae5f800/0x1808d16e4c98093b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980934 expref: 18 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960964.171975:0:14451:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5f800, rc 0) 00000100:00100000:2.0:1786960964.172064:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 316us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960964.172072:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786960964.172534:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786960964.172553:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98093b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.172563:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c98093b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960964.172705:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.172754:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960964.172903:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766466ce540 going to sleep for 11 seconds 00000100:00100000:2.0:1786960964.173034:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803264 00000100:00100000:2.0:1786960964.173040:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803264 00000100:00100000:2.0:1786960964.173070:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786960964.173077:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.173351:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960964.173358:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1786960964.173392:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.174729:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786960964.175136:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960964.175428:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665156c600 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.180585:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803392 00000100:00100000:3.0:1786960964.180925:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803392 00000100:00100000:3.0:1786960964.184697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960964.184754:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374144 00000100:00100000:3.0:1786960964.184873:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374144 00000100:00100000:3.0:1786960964.184924:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:3.0:1786960964.184933:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+11:13785:x1873763958374144:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.184948:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960964.184965:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169b800/0x1808d16e4c980942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c350 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.185019:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169b800/0x1808d16e4c980942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c350 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.185030:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169b800/0x1808d16e4c980942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c350 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.185039:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b800, rc 0) 00000100:00100000:3.0:1786960964.185086:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374144:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 154us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.185093:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 112 00000100:00100000:1.0:1786960964.188228:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786960964.188240:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.188502:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (13365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960964.188510:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786960964.188561:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.192723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960964.192822:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374272 00000100:00100000:3.0:1786960964.192831:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374272 00000100:00100000:3.0:1786960964.192878:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1786960964.192888:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374272:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.193160:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374272:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 273us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.193168:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000040:00080000:3.0:1786960964.194612:0:16655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1786960964.195049:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1786960964.195071:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786960964.195082:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98093b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.195093:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a7c00/0x1808d16e4c980934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c98093b expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786960964.195103:0:14454:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786960964.195105:0:14454:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9766818d0000 from 10 10000000:01000000:1.0:1786960964.195108:0:14454:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786960964.195139:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.195146:0:14454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960964.195163:0:14454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960964.195212:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.195266:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960964.195303:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff9766466ce480 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.195603:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803520 00000100:00100000:3.0:1786960964.195609:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803520 00000100:00100000:3.0:1786960964.195656:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786960964.195665:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+18:14454:x1873763967803520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.195678:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960964.195689:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169b200/0x1808d16e4c980950 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1808d16e4c980949 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.195721:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169b200/0x1808d16e4c980950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1808d16e4c980949 expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.195732:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169b200/0x1808d16e4c980950 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1808d16e4c980949 expref: 19 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.195751:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b200, rc 0) 00000100:00100000:3.0:1786960964.195789:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967803520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.195796:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1786960964.195836:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.195850:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980950 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.195859:0:14454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1808d16e4c980950 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960964.195905:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.195929:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960964.195942:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664133ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.197026:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960964.197054:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803648 00000100:00100000:3.0:1786960964.197061:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803648 00000100:00100000:3.0:1786960964.197086:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374400 00000100:00100000:3.0:1786960964.197088:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374400 00000100:00100000:3.0:1786960964.197104:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786960964.197111:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967803648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.197387:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967803648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.197395:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1786960964.197676:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:3.0:1786960964.197685:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374400:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.197836:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374400:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 151us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.197842:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:3.0:1786960964.197993:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.198041:0:14454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.198078:0:14454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960964.198093:0:14454:0:(client.c:2702:ptlrpc_set_wait()) set ffff97665156bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786960964.198109:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803776 00000100:00100000:3.0:1786960964.198113:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803776 00000100:00100000:3.0:1786960964.198136:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1786960964.198142:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766752fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967803776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.198260:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766752fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:14454:x1873763967803776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.198266:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1786960964.198300:0:14454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb0b67db-59e1-45af-922e-ea66d8c1a263:14454:1873763967803776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786960964.202078:0:16656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1786960964.207731:0:14454:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1786960964.207768:0:14454:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786960964.207780:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980950 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.207806:0:14454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9766743a6e00/0x1808d16e4c980949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1808d16e4c980950 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960964.208133:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960964.209635:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374528 00000100:00100000:3.0:1786960964.209647:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374528 00000100:00100000:3.0:1786960964.209734:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:3.0:1786960964.209744:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+12:13785:x1873763958374528:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786960964.209760:0:14452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960964.209776:0:14452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97664169bc00/0x1808d16e4c980957 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c357 expref: -99 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.209801:0:14452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97664169bc00/0x1808d16e4c980957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c357 expref: 13 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.209812:0:14452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97664169bc00/0x1808d16e4c980957 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c357 expref: 13 pid: 14452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960964.209821:0:14452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169bc00, rc 0) 00000100:00100000:3.0:1786960964.209889:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13785:x1873763958374528:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.209896:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:3.0:1786960964.212789:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960964.212853:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374656 00000100:00100000:1.0:1786960964.212864:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374656 00000100:00100000:1.0:1786960964.212924:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:1.0:1786960964.212933:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13785:x1873763958374656:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786960964.213584:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13785:x1873763958374656:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 649us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960964.213593:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:2.0:1786960964.217461:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960964.217545:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374784 00000100:00100000:3.0:1786960964.217555:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374784 00000100:00100000:3.0:1786960964.217650:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:3.0:1786960964.217660:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13785:x1873763958374784:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786960964.217887:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:13785:x1873763958374784:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 228us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960964.217895:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00010000:00010000:2.0:1786960964.534389:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960965.428547:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967803904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960965.428657:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960965.428739:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967803904 00000100:00100000:3.0:1786960965.428751:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967803904 00000100:00080000:2.0:1786960965.428809:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786960965.428832:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786960965.428849:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967803904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786960965.428885:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786960965.428979:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967803904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.428987:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786960965.429105:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967803904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786960965.556473:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786960965.803633:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960965.803693:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960965.803732:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960965.803768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960965.803781:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375168 00000100:00100000:2.0:1786960965.803790:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960965.803794:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375168 00000100:00100000:2.0:1786960965.803808:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960965.803833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960965.803853:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375680 00000100:00100000:2.0:1786960965.803856:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375680 00000100:00100000:3.0:1786960965.803863:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375296 00000100:00100000:3.0:1786960965.803865:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375296 00000100:00100000:2.0:1786960965.803876:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375552 00000100:00100000:2.0:1786960965.803879:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375552 00000100:00100000:3.0:1786960965.803884:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1786960965.803892:0:15143:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1786960965.803894:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958375168:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960965.804000:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958375168:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.804008:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1786960965.804030:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1786960965.804038:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958375680:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960965.804065:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958375680:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.804071:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1786960965.804093:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1786960965.804100:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958375296:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960965.804127:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958375296:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.804133:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:3.0:1786960965.804144:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1786960965.804146:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958374912 00000100:00100000:3.0:1786960965.804150:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958375552:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960965.804150:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958374912 00000100:00100000:3.0:1786960965.804172:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958375552:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.804178:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1786960965.804182:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:1.0:1786960965.804221:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958374912:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1786960965.804222:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960965.804227:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960965.804248:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958374912:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960965.804254:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:3.0:1786960965.804259:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375424 00000100:00100000:3.0:1786960965.804262:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375424 00000100:00100000:3.0:1786960965.804292:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375040 00000100:00100000:3.0:1786960965.804295:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375040 00000100:00100000:1.0:1786960965.804306:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:1.0:1786960965.804610:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958375424:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1786960965.804663:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958375424:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 349us (930us total) trans 0 rc 0/0 00000100:00080000:0.0:1786960965.804842:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786960965.804926:0:15143:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1786960965.808069:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1786960965.808096:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2344:x1873763958375040:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960965.808238:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2344:x1873763958375040:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 155us (4445us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960965.808246:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1786960965.809205:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1786960966.039403:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.039523:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958375808 00000100:00100000:2.0:1786960966.039534:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958375808 00000100:00100000:2.0:1786960966.039597:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:2.0:1786960966.039607:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+6:14446:x1873763958375808:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960966.039628:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.039669:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98095e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c35e expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039735:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039748:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039762:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039776:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039783:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.039789:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040288:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980973 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040298:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040317:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.040396:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786960966.040400:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960966.040488:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980973 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040501:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040506:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040512:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040518:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.040522:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040529:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040541:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:2.0:1786960966.040544:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.040548:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040554:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c980965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040579:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040585:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040590:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040596:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.040598:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040604:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040613:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff976664f8c800) 00010000:00010000:2.0:1786960966.040615:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.040618:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040623:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c98096c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040655:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c98095e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c35e expref: 8 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040669:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5ee00/0x1808d16e4c980973 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c35e expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.040688:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff976664f8c900) 00010000:00010000:2.0:1786960966.040690:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786960966.040692:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5ee00, rc 0) 00000100:00100000:2.0:1786960966.041139:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+7:14446:x1873763958375808:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1530us (1743us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.041147:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1786960966.049472:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.049561:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376064 00000100:00100000:3.0:1786960966.049570:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376064 00000100:00100000:3.0:1786960966.049636:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1786960966.049647:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+7:14446:x1873763958376064:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960966.049669:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.049699:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c98097a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c365 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.049775:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.049789:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.049802:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050037:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050047:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050055:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050680:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c98098f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050691:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c98098f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.050699:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c98098f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.050710:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786960966.051012:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051031:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051037:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051044:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.051048:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051056:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051069:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff976664f8c900) 00010000:00010000:3.0:1786960966.051072:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.051077:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051083:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980981 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051097:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051103:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051109:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051114:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169b600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.051124:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051131:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051140:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff976650b89c00) 00010000:00010000:3.0:1786960966.051142:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.051145:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.051151:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c980988 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.056631:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c98097a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c365 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.056991:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a000/0x1808d16e4c98098f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c365 expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.057001:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976650b89b00) 00010000:00010000:3.0:1786960966.057004:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.057008:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a000, rc 0) 00000100:00100000:3.0:1786960966.057097:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14446:x1873763958376064:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 7450us (7631us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1786960966.057105:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1786960966.071674:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.071881:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376192 00000100:00100000:2.0:1786960966.071891:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376192 00000100:00100000:2.0:1786960966.071945:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1786960966.071955:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14446:x1873763958376192:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1786960966.072069:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14446:x1873763958376192:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 116us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.072077:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960966.124848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.125242:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376320 00000100:00100000:1.0:1786960966.125255:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376320 00000100:00100000:1.0:1786960966.125339:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:1.0:1786960966.125351:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14452:x1873763958376320:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960966.125379:0:16120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960966.125427:0:16120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7200/0x1808d16e4c98099d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c36c expref: -99 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125525:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125541:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125553:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125570:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125576:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.125582:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126119:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126131:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126137:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126144:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a6000 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960966.126150:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126168:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126235:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:1.0:1786960966.126239:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960966.126244:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126251:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c9809a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126268:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126275:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126280:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126286:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:1.0:1786960966.126289:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126296:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126303:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff976661496800) 00010000:00010000:1.0:1786960966.126306:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960966.126308:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126324:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c9809ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126370:0:16120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7200/0x1808d16e4c98099d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c36c expref: 10 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126381:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:1.0:1786960966.126383:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786960966.126387:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7200/0x1808d16e4c98099d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c36c expref: 10 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.126397:0:16120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7200, rc 0) 00000100:00100000:1.0:1786960966.126691:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14452:x1873763958376320:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1338us (1865us total) trans 0 rc 301/301 00000100:00100000:1.0:1786960966.126700:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:3.0:1786960966.137798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.137987:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376448 00000100:00100000:2.0:1786960966.137997:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376448 00000100:00100000:2.0:1786960966.138058:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1786960966.138069:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14452:x1873763958376448:12345-192.168.203.23@tcp:700:lfs.0 00000100:00100000:2.0:1786960966.138163:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14452:x1873763958376448:12345-192.168.203.23@tcp:700:lfs.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.138170:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1786960966.142658:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.143735:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376704 00000100:00100000:2.0:1786960966.143750:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376704 00000100:00100000:2.0:1786960966.143836:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:2.0:1786960966.143847:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14452:x1873763958376704:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:2.0:1786960966.143930:0:14458:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960966.143958:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7000/0x1808d16e4c9808e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c2e7 expref: 9 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.143990:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:2.0:1786960966.143996:0:14458:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960966.144372:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.144386:0:14458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 5 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.145630:0:14458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.145686:0:14458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 5 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.145702:0:14458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 5 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960966.145717:0:14458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14458:1873763967804032:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960966.145837:0:14458:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960966.153761:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.154168:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376832 00000100:00100000:3.0:1786960966.154178:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376832 00010000:00010000:3.0:1786960966.154255:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 6 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960966.154300:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1786960966.154309:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958376832:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960966.154322:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960966.154329:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 6 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.154341:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 6 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.154362:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:3.0:1786960966.154367:0:14442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.154376:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.154383:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.154413:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960966.154470:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958376832:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 162us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.154478:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00010000:00010000:2.0:1786960966.154739:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c349 expref: 5 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960966.154756:0:14458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14458:1873763967804032:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960966.154775:0:14458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.154790:0:14458:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.154795:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.154816:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.154827:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.154836:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.157990:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786960966.158011:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158021:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158029:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158046:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.158051:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158059:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158089:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976661496b00) 00010000:00010000:2.0:1786960966.158093:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.158098:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.158104:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960966.158125:0:14458:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfb1ed3b reply state 00000000b761ecdd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960966.158134:0:14458:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786960966.158271:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+10:14452:x1873763958376704:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 14422us (15626us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1786960966.158280:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:3.0:1786960966.160129:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160144:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160163:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160169:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.160174:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160182:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160232:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff976664f8c800) 00010000:00010000:3.0:1786960966.160235:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.160240:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.160246:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c9809b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960966.290453:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.290551:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958376960 00000100:00100000:3.0:1786960966.290561:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958376960 00000100:00100000:3.0:1786960966.290621:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1786960966.290631:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+9:14460:x1873763958376960:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:3.0:1786960966.290656:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.290679:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c9809c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c373 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290746:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c9809c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290775:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c9809c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290787:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c9809c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.290846:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786960966.290850:0:14459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960966.290887:0:14459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c9809c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290913:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c9809c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c373 expref: 11 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290932:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169b600/0x1808d16e4c9809c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c373 expref: 10 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.290940:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:3.0:1786960966.290943:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960966.290946:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169b600, rc 0) 00000100:00100000:3.0:1786960966.291029:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+10:14460:x1873763958376960:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 400us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.291037:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1786960966.326415:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.326636:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958377088 00000100:00100000:2.0:1786960966.326646:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958377088 00000100:00100000:2.0:1786960966.326711:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1786960966.326721:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:14461:x1873763958377088:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960966.326741:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.326760:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c37a expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.326823:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9809d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.326837:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9809d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.326865:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9809d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.326926:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786960966.326931:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960966.326958:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9809d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.326994:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c37a expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.327014:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e000/0x1808d16e4c9809d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c37a expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.327023:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:2.0:1786960966.327026:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786960966.327029:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e000, rc 0) 00000100:00100000:2.0:1786960966.327098:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:14461:x1873763958377088:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 378us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.327105:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1786960966.331781:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.331869:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958377216 00000100:00100000:3.0:1786960966.331880:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958377216 00000100:00100000:3.0:1786960966.331943:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1786960966.331953:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:14461:x1873763958377216:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960966.331983:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.332017:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c9809dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c381 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332080:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332094:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332105:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332117:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332123:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332129:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332288:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332296:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332303:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.332337:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1786960966.332341:0:14459:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960966.332363:0:14459:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332381:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332387:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332393:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332399:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.332403:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332411:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332421:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:3.0:1786960966.332425:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.332429:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332434:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c9809e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332448:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332454:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332458:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332469:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.332472:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332477:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332484:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff976650b89300) 00010000:00010000:3.0:1786960966.332486:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.332488:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332494:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c9809ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332523:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c9809dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c381 expref: 8 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332536:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c381 expref: 7 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.332544:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976650b89500) 00010000:00010000:3.0:1786960966.332546:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786960966.332548:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a600, rc 0) 00000100:00100000:3.0:1786960966.332606:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+7:14461:x1873763958377216:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 655us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.332613:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1786960966.338798:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.338899:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958377472 00000100:00100000:2.0:1786960966.338910:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958377472 00000100:00100000:2.0:1786960966.338980:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1786960966.338991:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+7:14461:x1873763958377472:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960966.339014:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.339036:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c388 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.339177:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786960966.339459:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c388 expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.339474:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:2.0:1786960966.339477:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960966.339482:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c9809f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c388 expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.339496:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fc00, rc 0) 00000100:00100000:2.0:1786960966.339605:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+8:14461:x1873763958377472:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 615us (817us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1786960966.339612:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1786960966.346940:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.347160:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958377728 00000100:00100000:3.0:1786960966.347355:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958377728 00000100:00100000:3.0:1786960966.347468:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1786960966.347480:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+8:14461:x1873763958377728:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1786960966.347696:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960966.347721:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c9809f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c381 expref: 8 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.347738:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976650b89500) 00010000:00010000:3.0:1786960966.347747:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960966.347768:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.347782:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.347790:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960966.348005:0:14459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048b3cf21 reply state 0000000069b4fdb2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960966.348015:0:14459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1786960966.348029:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1786960966.348155:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+9:14461:x1873763958377728:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 678us (1222us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1786960966.348163:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1786960966.352899:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.353599:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958377984 00000100:00100000:1.0:1786960966.353609:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958377984 00000100:00100000:1.0:1786960966.353671:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:1.0:1786960966.353680:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+9:14461:x1873763958377984:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960966.354130:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+10:14461:x1873763958377984:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 449us (1236us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1786960966.354138:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00010000:00010000:2.0:1786960966.357312:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357331:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357337:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357343:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ae00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.357349:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357357:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357394:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976650b89300) 00010000:00010000:2.0:1786960966.357398:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1786960966.357404:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.357411:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980a06 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960966.358446:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.358523:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958378240 00000100:00100000:2.0:1786960966.358532:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958378240 00000100:00100000:2.0:1786960966.358593:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:2.0:1786960966.358606:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+9:14461:x1873763958378240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960966.358630:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.358647:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c38f expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358715:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358728:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358737:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358751:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358758:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.358780:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.358916:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1786960966.359019:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359027:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359033:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359038:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.359042:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359049:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359061:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:2.0:1786960966.359064:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.359068:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359074:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359086:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359103:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359109:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359114:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.359117:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359124:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359133:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff976664f8cb00) 00010000:00010000:2.0:1786960966.359135:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.359138:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359144:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359181:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c38f expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359242:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:2.0:1786960966.359244:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786960966.359249:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c38f expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.359268:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fc00, rc 0) 00000100:00100000:2.0:1786960966.359323:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+10:14461:x1873763958378240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 722us (882us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1786960966.359330:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:3.0:1786960966.368380:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.368526:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958378368 00000100:00100000:1.0:1786960966.368536:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958378368 00000100:00100000:1.0:1786960966.368618:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1786960966.368627:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+10:14461:x1873763958378368:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1786960966.368651:0:16120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960966.368673:0:16120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c980a29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c396 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368761:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368775:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368787:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786960966.368848:0:16120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1786960966.368853:0:16120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786960966.368877:0:16120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368904:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c980a29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 12 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368923:0:16120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 11 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.368933:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:1.0:1786960966.368935:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786960966.368939:0:16120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9766743a7400, rc 0) 00000100:00100000:1.0:1786960966.369014:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:87c6625f-b470-4281-b8b5-8effbb0d7a4e+11:14461:x1873763958378368:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 388us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960966.369028:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1786960966.380294:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960966.380412:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958378496 00000100:00100000:0.0:1786960966.380423:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958378496 00000100:00100000:0.0:1786960966.380481:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1786960966.380507:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+11:14461:x1873763958378496:12345-192.168.203.23@tcp:37:lfs.0 00000100:00100000:2.0:1786960966.389123:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:87c6625f-b470-4281-b8b5-8effbb0d7a4e+11:14461:x1873763958378496:12345-192.168.203.23@tcp:37:lfs.0 Request processed in 8605us (8824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.389138:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1786960966.397655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.397792:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958378752 00000100:00100000:1.0:1786960966.397802:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958378752 00000100:00100000:1.0:1786960966.397860:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1786960966.397871:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976655bd7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+11:14461:x1873763958378752:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960966.398146:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976655bd7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:87c6625f-b470-4281-b8b5-8effbb0d7a4e+12:14461:x1873763958378752:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 276us (499us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1786960966.398153:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000040:00080000:2.0:1786960966.452921:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1786960966.457565:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.457845:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958378880 00000100:00100000:2.0:1786960966.457855:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958378880 00000100:00100000:2.0:1786960966.457985:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1786960966.457996:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+10:14467:x1873763958378880:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1786960966.458018:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.458047:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c39d expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.458120:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.458135:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.458147:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.458162:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459310:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459324:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459449:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c980a4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459458:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c980a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459464:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c980a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.459777:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1786960966.459782:0:14458:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960966.459827:0:14458:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c980a4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459841:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459848:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459855:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459861:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fa00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.459866:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459885:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459897:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:2.0:1786960966.459900:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.459904:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459911:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459925:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459931:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459937:0:14458:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459942:0:14458:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.459945:0:14458:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459951:0:14458:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.459958:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff976664f8cb00) 00010000:00010000:2.0:1786960966.459961:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.459977:0:14458:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.460003:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.460043:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c39d expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.460058:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fe00/0x1808d16e4c980a4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c39d expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.460065:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960966.460068:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786960966.460070:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fe00, rc 0) 00000100:00100000:2.0:1786960966.460150:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+11:14467:x1873763958378880:12345-192.168.203.23@tcp:101:bash.0 Request processed in 2155us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.460158:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1786960966.465424:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.465709:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958379136 00000100:00100000:1.0:1786960966.465719:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958379136 00000100:00100000:1.0:1786960966.465782:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:1.0:1786960966.465793:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+11:14467:x1873763958379136:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:1.0:1786960966.465814:0:16120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786960966.465836:0:16120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c980a53 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3a4 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.466084:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.466099:0:16120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 11 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.466108:0:16120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.466160:0:16120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 11 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.466173:0:16120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 11 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960966.466212:0:16120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766770fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804160:192.168.203.23@tcp:104: 00000100:00100000:1.0:1786960966.466472:0:16120:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e771240 going to sleep for 11 seconds 00000100:00100000:1.0:1786960966.478262:0:16120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766770fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804160:192.168.203.23@tcp:104: 00010000:00010000:1.0:1786960966.478292:0:16120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960966.483520:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.483875:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958379264 00000100:00100000:1.0:1786960966.483886:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958379264 00010000:00010000:1.0:1786960966.483935:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 12 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960966.483993:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1786960966.484004:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+12:2344:x1873763958379264:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960966.484018:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960966.484025:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 12 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484040:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 12 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484086:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7400/0x1808d16e4c980a30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c396 expref: 12 pid: 16120 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484103:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:1.0:1786960966.484109:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484119:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484125:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960966.484161:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960966.484265:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+11:2344:x1873763958379264:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 261us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960966.484273:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00010000:00010000:2.0:1786960966.484726:0:16120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.484736:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.484759:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.484769:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.484777:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485491:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485502:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485511:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.485522:0:16120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786960966.485549:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485556:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485564:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485570:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960966.485574:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485582:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485594:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960966.485597:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960966.485601:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485619:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a7600/0x1808d16e4c980a5a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786960966.485632:0:16120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d221bad8 reply state 000000009340d4aa transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960966.485641:0:16120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786960966.485675:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6000/0x1808d16e4c980a53 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 14 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485690:0:16120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 13 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.485698:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960966.485700:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1786960966.485703:0:16120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5e800, rc 0) 00000100:00100000:2.0:1786960966.485766:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+14:14467:x1873763958379136:12345-192.168.203.23@tcp:101:bash.0 Request processed in 19975us (20352us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1786960966.485775:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00010000:00010000:3.0:1786960966.487327:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487356:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487364:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487381:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.487386:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487393:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487406:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff976664f8cb00) 00010000:00010000:3.0:1786960966.487409:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786960966.487413:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.487420:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a61 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960966.515670:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.515806:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958379392 00000100:00100000:3.0:1786960966.515816:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958379392 00000100:00100000:3.0:1786960966.515878:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1786960966.515889:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+13:14467:x1873763958379392:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1786960966.515912:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.515932:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980a76 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3ab expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516038:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516051:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516484:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.516525:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1786960966.516530:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960966.516552:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516564:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516599:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980a76 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 15 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516619:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.516628:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960966.516631:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960966.516635:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a400, rc 0) 00000100:00100000:3.0:1786960966.516689:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+14:14467:x1873763958379392:12345-192.168.203.23@tcp:101:bash.0 Request processed in 802us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.516696:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1786960966.524154:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.524324:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958379648 00000100:00100000:1.0:1786960966.524334:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958379648 00000100:00100000:1.0:1786960966.524471:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1786960966.524481:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+14:14467:x1873763958379648:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1786960966.524838:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+15:14467:x1873763958379648:12345-192.168.203.23@tcp:35:bash.0 Request processed in 357us (693us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1786960966.524846:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00010000:00010000:2.0:1786960966.580587:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786960966.632327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.632434:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958379904 00000100:00100000:3.0:1786960966.632445:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958379904 00000100:00100000:3.0:1786960966.632513:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1786960966.632524:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+15:14477:x1873763958379904:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1786960966.632549:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.632570:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3b2 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.632684:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1786960966.632802:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980a84 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3b2 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.632817:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff976650b89c00) 00010000:00010000:3.0:1786960966.632820:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786960966.632824:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3b2 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.632838:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a600, rc 0) 00000100:00100000:3.0:1786960966.633034:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+16:14477:x1873763958379904:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 511us (717us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1786960966.633041:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960966.640794:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960966.644042:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958380160 00000100:00100000:1.0:1786960966.644057:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958380160 00000100:00100000:1.0:1786960966.644242:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1786960966.644253:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+16:14477:x1873763958380160:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:1.0:1786960966.644532:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+17:14477:x1873763958380160:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 280us (3746us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1786960966.644541:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1786960966.689371:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.689619:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958380416 00000100:00100000:2.0:1786960966.689634:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958380416 00000100:00100000:2.0:1786960966.689711:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1786960966.689724:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+17:14480:x1873763958380416:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1786960966.689755:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960966.689780:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a92 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3b9 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.690137:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.690155:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.690169:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960966.690184:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786960966.690522:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980a92 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3b9 expref: 20 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.690544:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3b9 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.690555:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960966.690558:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786960966.690563:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fc00, rc 0) 00000100:00100000:2.0:1786960966.690776:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+19:14480:x1873763958380416:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1053us (1420us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1786960966.690785:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1786960966.695324:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960966.695377:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.695473:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958380544 00000100:00100000:2.0:1786960966.695487:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958380544 00000100:00100000:2.0:1786960966.695562:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1786960966.695574:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+19:2344:x1873763958380544:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786960966.695603:0:14443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960966.695652:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980a99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3b9 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960966.695676:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960966.695682:0:14443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786960966.695755:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+18:2344:x1873763958380544:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 183us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960966.695765:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960966.695898:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958380672 00000100:00100000:3.0:1786960966.695903:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958380672 00000100:00100000:3.0:1786960966.696106:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:3.0:1786960966.696117:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+18:14480:x1873763958380672:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:3.0:1786960966.696227:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696255:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696266:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696303:0:14459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696310:0:14459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696317:0:14459:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696325:0:14459:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960966.696330:0:14459:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696339:0:14459:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696349:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960966.696352:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786960966.696356:0:14459:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.696363:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aa7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960966.696411:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+18:14480:x1873763958380672:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 297us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.696426:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1786960966.699828:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.700039:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958380928 00000100:00100000:2.0:1786960966.700053:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958380928 00000100:00100000:2.0:1786960966.700133:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1786960966.700147:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+18:14480:x1873763958380928:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:2.0:1786960966.700502:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+19:14480:x1873763958380928:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 357us (686us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1786960966.700511:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1786960966.960029:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960966.960282:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958381184 00000100:00100000:3.0:1786960966.960295:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958381184 00000100:00100000:3.0:1786960966.960380:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1786960966.960393:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+19:14511:x1873763958381184:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:3.0:1786960966.960426:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960966.960453:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3c0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.960601:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ab5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.960619:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.960634:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960966.960648:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786960966.960830:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980aae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3c0 expref: 22 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.960854:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3c0 expref: 21 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.960864:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960966.960867:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960966.960872:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ac00, rc 0) 00000100:00100000:3.0:1786960966.961098:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+21:14511:x1873763958381184:12345-192.168.203.23@tcp:101:cat.0 Request processed in 707us (1083us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1786960966.961107:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:0.0:1786960966.964642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960966.964689:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960966.964778:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958381568 00000100:00100000:2.0:1786960966.964791:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958381568 00000100:00100000:2.0:1786960966.964866:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1786960966.964877:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+21:14511:x1873763958381568:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:2.0:1786960966.966053:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+22:14511:x1873763958381568:12345-192.168.203.23@tcp:35:cat.0 Request processed in 1165us (1349us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1786960966.966067:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1786960966.966345:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958381312 00000100:00100000:3.0:1786960966.966355:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958381312 00000100:00100000:3.0:1786960966.966432:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1786960966.966443:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+22:2344:x1873763958381312:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960966.966460:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960966.966492:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ab5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3c0 expref: 22 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960966.966516:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960966.966523:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960966.966564:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+21:2344:x1873763958381312:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 124us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960966.966571:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960967.052595:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.052722:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958381824 00000100:00100000:2.0:1786960967.052737:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958381824 00000100:00100000:2.0:1786960967.052841:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1786960967.052855:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+21:14517:x1873763958381824:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:2.0:1786960967.052907:0:16120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960967.052935:0:16120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ac3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3c7 expref: -99 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053091:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053111:0:16120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 22 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053120:0:16120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 22 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053130:0:16120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053174:0:16120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 22 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786960967.053293:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786960967.053408:0:16120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 22 pid: 14457 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.053427:0:16120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804288:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960967.053634:0:16120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 22 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.053644:0:16120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 22 pid: 16120 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.053670:0:16120:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804416:192.168.203.23@tcp:104: 00000100:00100000:2.0:1786960967.053699:0:16120:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1786960967.061448:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.061497:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960967.061593:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958381952 00000100:00100000:1.0:1786960967.061605:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958381952 00010000:00010000:1.0:1786960967.061664:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 23 pid: 14457 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960967.061713:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382080 00000100:00100000:1.0:1786960967.061716:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382080 00010000:00010000:1.0:1786960967.061732:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 24 pid: 16120 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960967.061750:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960967.061762:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+24:2343:x1873763958381952:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960967.061782:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960967.061791:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 24 pid: 14457 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.061806:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 24 pid: 14457 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.061840:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:1.0:1786960967.061847:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.061884:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.061891:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960967.061956:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+24:2343:x1873763958381952:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 195us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960967.061976:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960967.062040:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:1.0:1786960967.062048:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+23:2343:x1873763958382080:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786960967.062056:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786960967.062062:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 23 pid: 16120 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.062073:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 23 pid: 16120 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.062086:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:1.0:1786960967.062090:0:14444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.062099:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.062107:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.062127:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786960967.062146:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+23:2343:x1873763958382080:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 99us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960967.062160:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00010000:00010000:2.0:1786960967.062883:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980a7d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ab expref: 22 pid: 14457 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.062907:0:16120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766816caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804288:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960967.062925:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980a68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3a4 expref: 21 pid: 16120 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.062936:0:16120:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16120:1873763967804416:192.168.203.23@tcp:104: 00010000:00010000:2.0:1786960967.062974:0:16120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.062985:0:16120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.062991:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960967.063017:0:16120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1786960967.063284:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ac3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3c7 expref: 22 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.063300:0:16120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fa00/0x1808d16e4c980aca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3c7 expref: 21 pid: 16120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.063324:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960967.063327:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786960967.063331:0:16120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667ae5fa00, rc 0) 00000100:00100000:2.0:1786960967.063379:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+21:14517:x1873763958381824:12345-192.168.203.23@tcp:101:dd.0 Request processed in 10529us (10800us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1786960967.063388:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:0.0:1786960967.076730:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.077708:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382336 00000100:00100000:3.0:1786960967.077724:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382336 00000100:00100000:3.0:1786960967.077819:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:3.0:1786960967.077831:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+21:14517:x1873763958382336:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:3.0:1786960967.078392:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.078416:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.078431:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960967.078957:0:14457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1786960967.079108:0:14457:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004097a083 reply state 00000000e9aac787 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960967.079121:0:14457:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786960967.079319:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14517:x1873763958382336:12345-192.168.203.23@tcp:36:dd.0 Request processed in 1486us (2599us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1786960967.079328:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000020:00080000:3.0:1786960967.079334:0:14457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960967.081394:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081416:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081425:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081432:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ac00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.081438:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081447:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081470:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960967.081474:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.081480:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.081487:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980ad8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960967.085711:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.086120:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382464 00000100:00100000:3.0:1786960967.086135:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382464 00000100:00100000:3.0:1786960967.086250:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:3.0:1786960967.086263:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+23:14517:x1873763958382464:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1786960967.086295:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960967.086323:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980adf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3ce expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.086405:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980adf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ce expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.086423:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980adf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ce expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.086447:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960967.086451:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960967.086456:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a600, rc 0) 00000100:00100000:3.0:1786960967.086527:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14517:x1873763958382464:12345-192.168.203.23@tcp:101:dd.0 Request processed in 267us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960967.086554:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1786960967.100691:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.100798:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382720 00000100:00100000:0.0:1786960967.100812:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382720 00000100:00100000:0.0:1786960967.100933:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1786960967.100946:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14517:x1873763958382720:12345-192.168.203.23@tcp:103:dd.0 00010000:00010000:0.0:1786960967.100976:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960967.101022:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a600/0x1808d16e4c980adf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ce expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.101046:0:14444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:0.0:1786960967.101051:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960967.101117:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+23:14517:x1873763958382720:12345-192.168.203.23@tcp:103:dd.0 Request processed in 174us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.101125:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1786960967.103464:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.103544:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382848 00000100:00100000:2.0:1786960967.103558:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382848 00000100:00100000:2.0:1786960967.103634:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1786960967.103647:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+23:14517:x1873763958382848:12345-192.168.203.23@tcp:58:dd.0 00010000:00010000:2.0:1786960967.103797:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.103823:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.103838:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786960967.104778:0:14457:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786960967.104969:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1786960967.105055:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1786960967.105257:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+23:14517:x1873763958382848:12345-192.168.203.23@tcp:58:dd.0 Request processed in 1604us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.105271:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:1.0:1786960967.109673:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.109837:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958382976 00000100:00100000:3.0:1786960967.109851:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958382976 00000100:00100000:3.0:1786960967.109932:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1786960967.109946:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+23:14517:x1873763958382976:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1786960967.109985:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960967.110014:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3d5 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110089:0:14459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110102:0:14459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110126:0:14459:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110144:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110160:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960967.110164:0:14459:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960967.110168:0:14459:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 24 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.110177:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ac00, rc 0) 00000100:00100000:2.0:1786960967.111173:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14517:x1873763958382976:12345-192.168.203.23@tcp:101:dd.0 Request processed in 1223us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.111210:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000040:00080000:2.0:1786960967.476549:0:14491:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1786960967.476562:0:14491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786960967.476610:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1786960967.476618:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1786960967.476777:0:14491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14491:1873763967804544:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786960967.476925:0:14491:0:(client.c:2702:ptlrpc_set_wait()) set ffff97666b7ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786960967.487345:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.487719:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958383104 00000100:00100000:3.0:1786960967.487733:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958383104 00000100:00100000:3.0:1786960967.487813:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1786960967.487825:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958383104:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1786960967.487936:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958383104:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 113us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960967.487953:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1786960967.488261:0:14491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14491:1873763967804544:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786960967.497779:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.497910:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958383232 00000100:00100000:2.0:1786960967.497924:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958383232 00000100:00100000:2.0:1786960967.498012:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1786960967.498024:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14519:x1873763958383232:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786960967.498066:0:14458:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786960967.498738:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14519:x1873763958383232:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 712us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.498749:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1786960967.508834:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.508918:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958383360 00000100:00100000:2.0:1786960967.508932:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958383360 00000100:00100000:2.0:1786960967.509035:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1786960967.509047:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14519:x1873763958383360:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.509150:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.509173:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.509220:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.512096:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.512120:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.512132:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.512216:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513268:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513287:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786960967.513335:0:16120:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1786960967.513340:0:16120:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786960967.513354:0:16120:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513368:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513375:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513383:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513390:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e800 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.513394:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513401:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513423:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976650b89b00) 00010000:00010000:2.0:1786960967.513438:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.513444:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513451:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e800/0x1808d16e4c980af4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513468:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513474:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513481:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513486:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5e600 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.513489:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513496:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513503:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.513506:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.513509:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513515:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5e600/0x1808d16e4c980afb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513529:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513540:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513547:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513552:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe8200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.513555:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513561:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513568:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:2.0:1786960967.513571:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.513573:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.513579:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.513672:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14519:x1873763958383360:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 4624us (4849us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.513682:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:0.0:1786960967.516471:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.516631:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958383616 00000100:00100000:3.0:1786960967.516645:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958383616 00000100:00100000:3.0:1786960967.516726:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:3.0:1786960967.516740:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+24:14519:x1873763958383616:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960967.516769:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960967.516793:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b09 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3dc expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.516936:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.516965:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.516980:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960967.516992:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786960967.517121:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517129:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517152:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517159:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169ae00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960967.517163:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517171:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517238:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960967.517242:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960967.517248:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517265:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517327:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b09 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3dc expref: 26 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517339:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff976650b89b00) 00010000:00010000:3.0:1786960967.517341:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786960967.517346:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b09 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3dc expref: 26 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.517355:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a400, rc 0) 00000100:00100000:3.0:1786960967.517452:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958383616:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 716us (997us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1786960967.517470:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1786960967.525997:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.526111:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958383744 00000100:00100000:0.0:1786960967.526142:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958383744 00000100:00100000:0.0:1786960967.526392:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1786960967.526406:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958383744:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786960967.526466:0:14459:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786960967.526858:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958383744:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 454us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.526867:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:1.0:1786960967.530569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.530768:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384000 00000100:00100000:3.0:1786960967.530782:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384000 00000100:00100000:3.0:1786960967.530865:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:3.0:1786960967.530878:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+25:14519:x1873763958384000:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960967.530907:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960967.530936:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3e3 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786960967.532125:0:14457:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1786960967.532138:0:14457:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1786960967.532245:0:14457:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1786960967.533094:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.533115:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.534015:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.534130:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3e3 expref: 28 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.534156:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3e3 expref: 27 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.534166:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976650b89500) 00010000:00010000:3.0:1786960967.534181:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786960967.534222:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169ae00, rc 0) 00000100:00100000:3.0:1786960967.534324:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+27:14519:x1873763958384000:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3448us (3770us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1786960967.534335:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1786960967.539241:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.539416:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384256 00000100:00100000:2.0:1786960967.539430:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384256 00000100:00100000:2.0:1786960967.539496:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1786960967.539507:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+27:14519:x1873763958384256:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.539598:0:16120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960967.539651:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ae00/0x1808d16e4c980b25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3e3 expref: 27 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539676:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976650b89500) 00010000:00010000:2.0:1786960967.539688:0:16120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786960967.539720:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539736:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539747:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539765:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539772:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539778:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539882:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539889:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539896:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539903:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe8200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.539914:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539923:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539933:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff976661496800) 00010000:00010000:2.0:1786960967.539936:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.539940:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539946:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b33 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539966:0:16120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539974:0:16120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539979:0:16120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539985:0:16120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe9e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.539987:0:16120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.539993:0:16120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.540000:0:16120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb7eb8dbd (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.540002:0:16120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.540011:0:16120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.540017:0:16120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb7eb8dbd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.540134:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+26:14519:x1873763958384256:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 627us (947us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786960967.540142:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:0.0:1786960967.548843:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.548940:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384384 00000100:00100000:2.0:1786960967.548954:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384384 00000100:00100000:2.0:1786960967.549034:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:2.0:1786960967.549047:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+26:14519:x1873763958384384:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.549076:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960967.549107:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b41 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3ea expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549160:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549178:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549236:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549382:0:14458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ea expref: 28 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549526:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe8200/0x1808d16e4c980b48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ea expref: 27 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.549546:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.549549:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786960967.549554:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667bfe8200, rc 0) 00000100:00100000:2.0:1786960967.549762:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+27:14519:x1873763958384384:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 715us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.549770:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:1.0:1786960967.553098:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.553497:0:16120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384640 00000100:00100000:2.0:1786960967.553509:0:16120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384640 00000100:00100000:2.0:1786960967.553565:0:16120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1786960967.553584:0:16120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+27:14519:x1873763958384640:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.553717:0:16120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.553737:0:16120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.553750:0:16120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786960967.555661:0:16120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1786960967.555687:0:16120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449582499162ns, next at 450582494535ns, rc = 0 00000004:00010000:2.0:1786960967.555833:0:16120:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000028a5af1c reply state 000000000ae5ce18 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.555847:0:16120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786960967.555992:0:16120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+29:14519:x1873763958384640:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2405us (2912us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1786960967.556029:0:16120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00010000:00010000:3.0:1786960967.561783:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561807:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561817:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561823:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe9c00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960967.561830:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561838:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561860:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960967.561863:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786960967.561868:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.561874:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9c00/0x1808d16e4c980b4f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960967.565846:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.566227:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384768 00000100:00100000:2.0:1786960967.566240:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384768 00000100:00100000:2.0:1786960967.566319:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1786960967.566331:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+28:14519:x1873763958384768:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.566362:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786960967.566389:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3f1 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.566481:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 29 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.566500:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 29 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.566524:0:14458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.566527:0:14458:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786960967.566532:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97667bfe9e00, rc 0) 00000100:00100000:2.0:1786960967.567562:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+29:14519:x1873763958384768:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1223us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.567581:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:1.0:1786960967.574069:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.575158:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958384896 00000100:00100000:3.0:1786960967.575173:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958384896 00000100:00100000:0.0:1786960967.576810:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1786960967.576832:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958384896:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786960967.577377:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2344:x1873763958384896:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 551us (3320us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1786960967.577386:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00080000:3.0:1786960967.580017:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786960967.580639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.580779:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958385152 00000100:00100000:2.0:1786960967.580793:0:14460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958385152 00000100:00100000:2.0:1786960967.580866:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1786960967.580878:0:14460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+29:14519:x1873763958385152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786960967.581484:0:14460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+30:14519:x1873763958385152:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 605us (849us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1786960967.581505:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:1.0:1786960967.585045:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.585367:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958385408 00000100:00100000:0.0:1786960967.585380:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958385408 00000100:00100000:0.0:1786960967.585465:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:0.0:1786960967.585478:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+30:14519:x1873763958385408:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960967.585641:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+30:14519:x1873763958385408:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 164us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.585650:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:1.0:1786960967.590375:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960967.590615:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958385536 00000100:00100000:3.0:1786960967.590631:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958385536 00000100:00100000:3.0:1786960967.590712:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:3.0:1786960967.590725:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+30:14519:x1873763958385536:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786960967.590752:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786960967.590778:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b5d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3f8 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.590903:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.590920:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.590934:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786960967.591156:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786960967.591481:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.591523:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b5d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f8 expref: 32 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.591546:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f8 expref: 31 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.591556:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960967.591559:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786960967.591562:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97664169a800, rc 0) 00000100:00100000:2.0:1786960967.592779:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766816e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+31:14519:x1873763958385536:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 2046us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.592791:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1786960967.596304:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.596445:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958385664 00000100:00100000:0.0:1786960967.596458:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958385664 00000100:00100000:0.0:1786960967.596534:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960967.596547:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+6:2343:x1873763958385664:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786960967.596582:0:15143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786960967.596629:0:15143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa78abac9f790c3ff expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786960967.596665:0:15143:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a82dc48, blocks: 0x1 00010000:00010000:0.0:1786960967.596692:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1786960967.596698:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960967.596711:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 7 pid: 15143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.596733:0:15143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 7 pid: 15143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.596750:0:15143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff976677927400, rc 0) 00000100:00100000:0.0:1786960967.596815:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:2343:x1873763958385664:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 271us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.596823:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1786960967.601072:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.601180:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958385920 00000100:00100000:0.0:1786960967.601260:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958385920 00000100:00100000:0.0:1786960967.601338:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:0.0:1786960967.601350:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+31:14519:x1873763958385920:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786960967.601502:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+31:14519:x1873763958385920:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 154us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.601511:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00010000:00010000:2.0:1786960967.604620:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786960967.605703:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.605783:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386048 00000100:00100000:2.0:1786960967.605797:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386048 00000100:00100000:2.0:1786960967.605880:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1786960967.605892:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+31:14519:x1873763958386048:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1786960967.702972:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766597a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+31:14519:x1873763958386048:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 97057us (97254us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960967.702990:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000001:00080000:3.0:1786960967.703093:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:3.0:1786960967.703109:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1786960967.703119:0:5833:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1786960967.703125:0:5833:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1786960967.703582:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786960967.703603:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967804672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960967.703690:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786960967.703777:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967804672 00000100:00100000:1.0:1786960967.703787:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967804672 00000100:00100000:1.0:1786960967.703873:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786960967.703884:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967804672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1786960967.704092:0:15144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786960967.704097:0:15144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1786960967.704099:0:15144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786960967.704102:0:15144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786960968 -> 1786960968 00002000:00010000:1.0:1786960967.704105:0:15144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786960967.704147:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1873763967804672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (457us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1786960967.704155:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1786960967.704175:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1786960967.704260:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9766779dad80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1786960967.704268:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766779dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967804672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1786960967.708568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.708883:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386176 00000100:00100000:0.0:1786960967.708896:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386176 00000100:00100000:0.0:1786960967.708978:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1786960967.708989:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:2343:x1873763958386176:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1786960967.709168:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+7:2343:x1873763958386176:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 179us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.709176:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:0.0:1786960967.715827:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.715938:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386432 00000100:00100000:2.0:1786960967.715953:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386432 00000100:00100000:2.0:1786960967.716044:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:2.0:1786960967.716058:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+14:14519:x1873763958386432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.716135:0:14459:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786960967.716171:0:14459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a800/0x1808d16e4c980b64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f8 expref: 14 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.716507:0:14459:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.716514:0:14459:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786960967.717094:0:14459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.717116:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.717131:0:14459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786960967.717912:0:14459:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ace76c4b reply state 000000009bf2a439 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960967.717927:0:14459:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786960967.718138:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+15:14519:x1873763958386432:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 2078us (2319us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1786960967.718149:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1786960967.730838:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:2.0:1786960967.731441:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731458:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731467:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731499:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97664169a400 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:2.0:1786960967.731506:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731515:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731539:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.731543:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786960967.731548:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.731555:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169a400/0x1808d16e4c980b72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14459 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960967.735049:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386560 00000100:00100000:0.0:1786960967.735070:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386560 00000100:00100000:0.0:1786960967.735152:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1786960967.735177:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+7:2342:x1873763958386560:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786960967.735728:0:15144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1786960967.735733:0:15144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1786960967 00002000:00010000:0.0:1786960967.735736:0:15144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1786960967 00002000:00010000:0.0:1786960967.735739:0:15144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786960968 -> 1786960967 00002000:00010000:0.0:1786960967.735742:0:15144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1786960967.735836:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674116680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+8:2342:x1873763958386560:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 662us (5013us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1786960967.735846:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1786960967.739864:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1786960967.744822:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386688 00000100:00100000:2.0:1786960967.744844:0:15143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386688 00000100:00100000:2.0:1786960967.745008:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1786960967.745022:0:15143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+8:2343:x1873763958386688:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786960967.745087:0:15143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745111:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960967.745117:0:15143:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960967.745124:0:15143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745143:0:15143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745258:0:15143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745269:0:15143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745279:0:15143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745287:0:15143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe8e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960967.745292:0:15143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745303:0:15143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745323:0:15143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.745332:0:15143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a6d2f82/0x1808d16e4c980b79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.745462:0:15143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+8:2343:x1873763958386688:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 443us (5613us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960967.745481:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1786960967.757022:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.757363:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958386944 00000100:00100000:0.0:1786960967.757377:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958386944 00000100:00100000:0.0:1786960967.757505:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1786960967.757517:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+14:14519:x1873763958386944:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786960967.757635:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.757668:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.757708:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.759134:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.759162:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 15 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.759171:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.759252:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 15 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.759272:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 15 pid: 14458 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960967.759292:0:14457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14457:1873763967804800:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960967.759426:0:14457:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561300 going to sleep for 11 seconds 00000100:00100000:3.0:1786960967.767121:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.767930:0:14457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14457:1873763967804800:192.168.203.23@tcp:104: 00010000:00010000:0.0:1786960967.767975:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960967.771524:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387072 00000100:00100000:2.0:1786960967.771546:0:14443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387072 00010000:00010000:2.0:1786960967.776768:0:14443:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 16 pid: 14458 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960967.777010:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1786960967.777041:0:14443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+16:2344:x1873763958387072:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786960967.777065:0:14443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786960967.777096:0:14443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 16 pid: 14458 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777112:0:14443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 16 pid: 14458 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777145:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667bfe9e00/0x1808d16e4c980b56 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3f1 expref: 16 pid: 14458 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777171:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:0.0:1786960967.777177:0:14443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777242:0:14443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777252:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777287:0:14443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786960967.777368:0:14443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+15:2344:x1873763958387072:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 346us (10261us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.777377:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00010000:00010000:0.0:1786960967.777424:0:14457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.777433:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960967.778016:0:14457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1786960967.778467:0:14457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1786960967.778766:0:14457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1786960967.778890:0:14457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14457:1873763967804928:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786960967.779153:0:14457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960967.779273:0:14457:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e5610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786960967.780397:0:14462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967804928 00000100:00100000:0.0:1786960967.780408:0:14462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967804928 00000100:00100000:0.0:1786960967.780535:0:14462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786960967.780546:0:14462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14457:x1873763967804928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1786960967.780678:0:14462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14457:x1873763967804928:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960967.780685:0:14462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786960967.780769:0:14457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14457:1873763967804928:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1786960967.782067:0:14457:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1786960967.782230:0:14457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14457:1873763967805056:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786960967.782317:0:14457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960967.782416:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805056 00000100:00100000:3.0:1786960967.782425:0:14463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805056 00000100:00100000:3.0:1786960967.782471:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960967.782480:0:14463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14457:x1873763967805056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1786960967.782718:0:14463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14457:x1873763967805056:12345-0@lo:1000:mdt00_000.0 Request processed in 237us (400us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1786960967.782726:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786960967.782755:0:14457:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807900 going to sleep for 11 seconds 00000100:00100000:3.0:1786960967.782784:0:14457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14457:1873763967805056:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1786960967.782826:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782839:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782847:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782854:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926200 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960967.782858:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782866:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782887:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:3.0:1786960967.782890:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960967.782897:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782903:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926200/0x1808d16e4c980b87 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782940:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782965:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782972:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782977:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667ae5fc00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:3.0:1786960967.782981:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782988:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.782998:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:3.0:1786960967.783000:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786960967.783010:0:14457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.783023:0:14457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.783034:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960967.783095:0:14457:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97664169ac00/0x1808d16e4c980aed lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3d5 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960967.783111:0:14457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14457:1873763967805184:192.168.203.23@tcp:105: 00000100:00100000:3.0:1786960967.783222:0:14457:0:(client.c:2702:ptlrpc_set_wait()) set ffff97667a807b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786960967.786803:0:14457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9766772fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14457:1873763967805184:192.168.203.23@tcp:105: 00010000:00010000:0.0:1786960967.786834:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.786846:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97667ae5fc00/0x1808d16e4c980ae6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.786951:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.786978:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.786990:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787001:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787009:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960967.787127:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00010000:00010000:0.0:1786960967.787326:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787333:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927e00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960967.787337:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787345:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787358:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:0.0:1786960967.787361:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786960967.787365:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787371:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677927e00/0x1808d16e4c980b8e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787383:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787391:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787397:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787402:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926a00 already unused, calling callback (ffffffffc1f824f0) 00010000:00010000:0.0:1786960967.787405:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787423:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787433:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff976664f8c100) 00010000:00010000:0.0:1786960967.787436:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786960967.787440:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.787446:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff976677926a00/0x1808d16e4c980b80 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960967.787457:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387200 00000100:00100000:1.0:1786960967.787469:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387200 00000100:00100000:1.0:1786960967.787544:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:1.0:1786960967.787559:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976655bd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+19:14517:x1873763958387200:12345-192.168.203.23@tcp:49:dd.0 00000100:00100000:0.0:1786960967.787694:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+19:14519:x1873763958386944:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 30175us (30684us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1786960967.787708:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000020:00080000:0.0:1786960967.787714:0:14457:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1786960967.787728:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976655bd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+18:14517:x1873763958387200:12345-192.168.203.23@tcp:49:dd.0 Request processed in 168us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786960967.787739:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000040:00080000:3.0:1786960967.788776:0:14491:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1786960967.788783:0:14491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786960967.788819:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1786960967.788825:0:14491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1786960967.795972:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960967.797420:0:14461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387456 00000100:00100000:1.0:1786960967.797437:0:14461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387456 00000100:00100000:1.0:1786960967.797526:0:14461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:1.0:1786960967.797539:0:14461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+18:14519:x1873763958387456:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786960967.801017:0:14461:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786960967.801180:0:14461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1786960967.802136:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803626:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803654:0:14461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803668:0:14461:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803675:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803683:0:14461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960967.803708:0:14461:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786960967.803875:0:14461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7574538c-a858-46d1-9879-75c3b8cac0cc+20:14519:x1873763958387456:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 6332us (7919us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1786960967.803888:0:14461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000020:00080000:1.0:1786960967.803896:0:14461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786960967.804021:0:14445:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786960967.804031:0:14445:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.804039:0:14445:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a6c00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960967.804044:0:14445:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.804053:0:14445:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.804070:0:14445:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff976664f8ca00) 00010000:00010000:2.0:1786960967.804073:0:14445:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786960967.804078:0:14445:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.804085:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9766743a6c00/0x1808d16e4c980b95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960967.804103:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960967.804105:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960967.804107:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960967.999242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960967.999345:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387584 00000100:00100000:0.0:1786960967.999358:0:15147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387584 00000100:00100000:0.0:1786960967.999447:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1786960967.999459:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+8:2342:x1873763958387584:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1786960967.999508:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.999534:0:15147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 8 pid: 15143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.999545:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1786960967.999550:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960967.999571:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.999616:0:15147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 8 pid: 15143 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960967.999633:0:15147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 8 pid: 15143 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960967.999651:0:15147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15147:1873763967805312:192.168.203.23@tcp:104: 00000100:00100000:0.0:1786960967.999832:0:15147:0:(client.c:2702:ptlrpc_set_wait()) set ffff97664e561000 going to sleep for 11 seconds 00000100:00100000:3.0:1786960968.007727:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960968.007768:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960968.007798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960968.007801:0:15149:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1786960968.007815:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1786960968.007818:0:15149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1786960968.007835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960968.007850:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960968.007865:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960968.007894:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.007917:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387712 00000100:00100000:3.0:1786960968.007923:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1786960968.007929:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387712 00000100:00100000:1.0:1786960968.008013:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008019:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387840 00000100:00100000:1.0:1786960968.008021:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387840 00000100:00100000:1.0:1786960968.008051:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008056:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958387968 00000100:00100000:1.0:1786960968.008058:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958387968 00000100:00100000:1.0:1786960968.008067:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008070:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388096 00000100:00100000:1.0:1786960968.008073:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388096 00000100:00100000:1.0:1786960968.008081:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008084:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388224 00000100:00100000:1.0:1786960968.008086:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388224 00000100:00100000:1.0:1786960968.008096:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008101:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388352 00000100:00100000:1.0:1786960968.008103:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388352 00000100:00100000:1.0:1786960968.008113:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786960968.008119:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388480 00000100:00100000:1.0:1786960968.008122:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388480 00000100:00100000:3.0:1786960968.008318:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388608 00000100:00100000:3.0:1786960968.008324:0:14444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388608 00010000:00010000:3.0:1786960968.008356:0:14444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 16 pid: 15143 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960968.008361:0:15147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97666b4b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15147:1873763967805312:192.168.203.23@tcp:104: 00000100:00100000:3.0:1786960968.008395:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:2.0:1786960968.008401:0:15147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786960968.008408:0:14444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+16:2344:x1873763958388608:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786960968.008430:0:14444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786960968.008459:0:14444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 16 pid: 15143 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960968.008487:0:14444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 16 pid: 15143 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960968.008517:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007c807a8/0x1808d16e4c980b6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa78abac9f790c3ff expref: 16 pid: 15143 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960968.008538:0:14444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960968.008543:0:14444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786960968.008549:0:14444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960968.008560:0:14444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786960968.008594:0:14444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786960968.008660:0:14444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+15:2344:x1873763958388608:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 255us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960968.008859:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:2.0:1786960968.009470:0:15147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.009483:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960968.011005:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960968.011098:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+14:2342:x1873763958387712:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1786960968.011152:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.011174:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.011179:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.011209:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.011225:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960968.149254:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:3.0:1786960968.149285:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1786960968.149295:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1786960968.149301:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1786960968.158037:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786960968.158049:0:15147:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1786960967 -> 1786960968 00002000:00010000:2.0:1786960968.158052:0:15147:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1786960967 -> 1786960968 00002000:00010000:2.0:1786960968.158055:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1786960968.158074:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158090:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158101:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158109:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926a00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960968.158114:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158125:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158167:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.158175:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d133413/0x1808d16e4c980b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960968.158361:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+15:2342:x1873763958387584:12345-192.168.203.23@tcp:4:dd.0 Request processed in 158897us (159174us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1786960968.158379:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1786960968.158424:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1786960968.158438:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+14:2342:x1873763958387840:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:2.0:1786960968.159448:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.159532:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960968.159538:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960968.159545:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.159561:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960968.251852:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1786960968.252654:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:0.0:1786960968.252692:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252708:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252719:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252728:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960968.252735:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252746:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252772:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.252782:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980ba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960968.252910:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766772fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+14:2342:x1873763958387712:12345-192.168.203.23@tcp:4:dd.0 Request processed in 241816us (245190us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1786960968.252922:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1786960968.252970:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1786960968.252985:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+13:2342:x1873763958387968:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1786960968.253032:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.253047:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.253052:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.253060:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.253074:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786960968.290671:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1786960968.290682:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1786960968.290702:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290718:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290730:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290739:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe9000 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960968.290745:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290757:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290801:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.290810:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030876a07/0x1808d16e4c980baa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960968.290934:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+15:2342:x1873763958387840:12345-192.168.203.23@tcp:4:dd.0 Request processed in 132494us (283156us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1786960968.290948:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:1.0:1786960968.290999:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1786960968.291015:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+14:2342:x1873763958388096:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:1.0:1786960968.291059:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.291074:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960968.291080:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786960968.291088:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.291103:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786960968.298147:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:2.0:1786960968.356609:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1786960968.363796:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1786960968.363808:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1786960968.363827:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363845:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363856:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363864:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960968.363869:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363879:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363931:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.363941:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960968.364082:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+12:2342:x1873763958387968:12345-192.168.203.23@tcp:4:dd.0 Request processed in 111096us (356275us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1786960968.364094:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1786960968.364139:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1786960968.364155:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+11:2342:x1873763958388224:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1786960968.364254:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.364270:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.364275:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.364282:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.364295:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786960968.423502:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1786960968.423653:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:2.0:1786960968.423677:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423712:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423723:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423732:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9766743a7400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:2.0:1786960968.423738:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423750:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423777:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.423786:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19dd9ad/0x1808d16e4c980bb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786960968.423962:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+11:2342:x1873763958388096:12345-192.168.203.23@tcp:4:dd.0 Request processed in 132934us (416127us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1786960968.423983:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:2.0:1786960968.424025:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1786960968.424040:0:15147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+10:2342:x1873763958388352:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:2.0:1786960968.424082:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.424104:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960968.424110:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786960968.424118:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786960968.424132:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786960968.470505:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1786960968.474925:0:16690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1786960968.474938:0:16690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:0.0:1786960968.474985:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475001:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475012:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475020:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677927e00 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:0.0:1786960968.475025:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475035:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475059:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.475068:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b732ff45/0x1808d16e4c980bbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786960968.478082:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+10:2342:x1873763958388224:12345-192.168.203.23@tcp:4:dd.0 Request processed in 111024us (467337us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1786960968.478108:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:0.0:1786960968.478157:0:16690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1786960968.478176:0:16690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+9:2342:x1873763958388480:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:0.0:1786960968.478308:0:16690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.478330:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.478336:0:16690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786960968.478342:0:16690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786960968.478358:0:16690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960968.500437:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967805824:0@lo:400:kworker.0 00000100:00100000:1.0:1786960968.500539:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960968.500606:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967805696:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.500668:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967805568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786960968.501078:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967805952:0@lo:400:kworker.0 00000100:00100000:2.0:1786960968.501116:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960968.501263:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786960968.501305:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967806208:0@lo:400:kworker.0 00000100:00100000:2.0:1786960968.501330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786960968.501380:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805824 00000100:00100000:3.0:1786960968.501391:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805824 00000100:00100000:3.0:1786960968.501469:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805696 00000100:00100000:3.0:1786960968.501473:0:15142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805696 00000100:00100000:3.0:1786960968.501497:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960968.501507:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff976674115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967805824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960968.501584:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff976674115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967805824:12345-0@lo:400:kworker.0 Request processed in 78us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960968.501592:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786960968.501613:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960968.501619:0:15142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967805696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960968.501651:0:15142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1873763967805696:12345-0@lo:400:kworker.0 Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960968.501657:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786960968.501677:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805952 00000100:00100000:3.0:1786960968.501681:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805952 00000100:00100000:3.0:1786960968.501706:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967806208 00000100:00100000:3.0:1786960968.501709:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967806208 00000100:00100000:3.0:1786960968.501730:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960968.501737:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967805952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786960968.501771:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1873763967805952:12345-0@lo:400:kworker.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960968.501778:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786960968.501790:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786960968.501796:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967806208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1786960968.501805:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786960968.501812:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786960968.501822:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1873763967806208:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960968.501828:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786960968.501856:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1873763967805952:0@lo:400:kworker.0 00000100:00100000:2.0:1786960968.502000:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1786960968.502007:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9766779dad80, transno 8589934595 00000004:00080000:2.0:1786960968.502022:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1786960968.502088:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1873763967805696:0@lo:400:kworker.0 00000100:00100000:2.0:1786960968.502104:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1873763967806208:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.502237:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960968.502278:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967805440:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.502378:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960968.502718:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97667a69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967806080:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.502757:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960968.502795:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805440 00000100:00100000:0.0:1786960968.502801:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805440 00000100:00100000:0.0:1786960968.502842:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786960968.502850:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3287:x1873763967805440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.502909:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb0b67db-59e1-45af-922e-ea66d8c1a263+19:3287:x1873763967805440:12345-0@lo:400:kworker.0 Request processed in 60us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960968.502917:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786960968.502970:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967806080 00000100:00100000:0.0:1786960968.502974:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967806080 00000100:00100000:0.0:1786960968.503015:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1786960968.503022:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967806080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.503055:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1873763967806080:12345-0@lo:400:kworker.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960968.503061:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1786960968.503078:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786960968.503100:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb0b67db-59e1-45af-922e-ea66d8c1a263:3287:1873763967805440:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.503117:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1873763967806080:0@lo:400:kworker.0 00000100:00100000:2.0:1786960968.503151:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967805568 00000100:00100000:2.0:1786960968.503162:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967805568 00000100:00100000:2.0:1786960968.503238:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786960968.503247:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967805568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786960968.503280:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786960968.503343:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97666b4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1873763967805568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1786960968.503350:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786960968.503429:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97667a69f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967805824:0@lo:400:kworker.0 00000100:00100000:0.0:1786960968.503650:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674114000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1873763967805568:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1786960968.508522:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1786960968.510222:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1786960968.510234:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1786960968.510256:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510272:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510283:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510292:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97667bfe9400 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960968.510298:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510308:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510335:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.510344:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29fa30b/0x1808d16e4c980bc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960968.510473:0:15147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7574538c-a858-46d1-9879-75c3b8cac0cc+9:2342:x1873763958388352:12345-192.168.203.23@tcp:4:dd.0 Request processed in 86431us (502613us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1786960968.510501:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000001:00080000:2.0:1786960968.542162:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1786960968.542865:0:16690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542885:0:16690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542895:0:16690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542904:0:16690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff976677926600 already unused, calling callback (ffffffffc157afd0) 00010000:00010000:1.0:1786960968.542909:0:16690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542919:0:16690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542943:0:16690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786960968.542960:0:16690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5368b4/0x1808d16e4c980bcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786960968.543104:0:16690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2342:x1873763958388480:12345-192.168.203.23@tcp:4:dd.0 Request processed in 64929us (535230us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1786960968.543116:0:16690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00010000:00010000:2.0:1786960968.628459:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786960969.652483:0:14445:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786960970.195500:0:16729:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1786960970.548574:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff976674114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967806336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786960970.548676:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786960970.548856:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763967806336 00000100:00100000:0.0:1786960970.548866:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763967806336 00000100:00100000:0.0:1786960970.548963:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786960970.548976:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97667a69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967806336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786960970.549029:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1786960970.549093:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97667a69e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1873763967806336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.549101:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786960970.549161:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff976674114e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1873763967806336:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786960970.549350:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786960970.676615:0:14446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786960970.902847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.902919:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.902968:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.902997:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.903025:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.903044:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.903069:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1786960970.903102:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388736 00000100:00100000:3.0:1786960970.903114:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388736 00000100:00100000:3.0:1786960970.903210:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:3.0:1786960970.903223:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958388736:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1786960970.903314:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766771e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fc7daf30-e2f7-464c-a127-8955fc940cbc+13:2344:x1873763958388736:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1786960970.903323:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:0.0:1786960970.903439:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388864 00000100:00100000:0.0:1786960970.903443:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388864 00000100:00100000:0.0:1786960970.903495:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958389248 00000100:00100000:0.0:1786960970.903498:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958389248 00000100:00100000:0.0:1786960970.903522:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1786960970.903529:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+20:2344:x1873763958388864:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903582:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+20:2344:x1873763958388864:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 53us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903589:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1786960970.903601:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960970.903606:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958389248:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903627:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+6:2344:x1873763958389248:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 21us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903633:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1786960970.903649:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958389120 00000100:00100000:0.0:1786960970.903652:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958389120 00000100:00100000:0.0:1786960970.903670:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958389376 00000100:00100000:0.0:1786960970.903672:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958389376 00000100:00100000:0.0:1786960970.903685:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958388992 00000100:00100000:0.0:1786960970.903687:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958388992 00000100:00100000:0.0:1786960970.903697:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873763958389504 00000100:00100000:0.0:1786960970.903699:0:15144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873763958389504 00000100:00100000:0.0:1786960970.903713:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960970.903719:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958389120:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903744:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958389120:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 25us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903750:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1786960970.903761:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1786960970.903766:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958389376:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903786:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958389376:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 19us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903801:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1786960970.903812:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1786960970.903817:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958388992:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903840:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7574538c-a858-46d1-9879-75c3b8cac0cc+5:2344:x1873763958388992:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 23us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903846:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1786960970.903856:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1786960970.903862:0:15144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9766770f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958389504:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1786960970.903883:0:15144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9766770f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:87c6625f-b470-4281-b8b5-8effbb0d7a4e+5:2344:x1873763958389504:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 22us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1786960970.903889:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00080000:3.0:1786960970.904458:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786960970.904466:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786960970.904469:0:14453:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 29538 lines, 29538 kept, 0 dropped, 0 bad.