00000001:02000400:3.0F:1787759093.893773:0:2977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_hostid 00000001:02000400:3.0:1787759105.303924:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787759106.267906:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1135 MB/s 00000001:01000000:2.0:1787759106.518070:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1495 MB/s 00000001:01000000:2.0:1787759106.767479:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9655 MB/s 00000020:02000000:2.0:1787759107.094474:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_105_g7e37689 00000400:02000000:2.0:1787759107.520595:0:3287:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.138@tcp [8/256/0/180] 00008000:02000000:0.0F:1787759109.923168:0:3436:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1787759128.729122:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787759132.788802:0:5816:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787759132.788806:0:5816:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787759132.788942:0:5816:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bf2d5941 00000080:02000400:2.0:1787759132.788953:0:5816:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787759132.791813:0:5816:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787759132.791826:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787759132.791860:0:5816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001ca42ba4) 00000020:00000080:2.0:1787759132.791879:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1787759132.801776:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787759132.802158:0:5816:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787759132.815738:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787759132.815785:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787759132.815807:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787759132.815846:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787759132.815885:0:5816:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787759132.816189:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787759132.816195:0:5816:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787759132.816202:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf29c 00000020:01000004:1.0:1787759132.816207:0:5816:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787759132.816212:0:5816:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787759132.816216:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bf2d5941 from MGS 00000020:01000004:1.0:1787759132.816220:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787759132.816236:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000b3646b5e) 00000020:00000080:1.0:1787759132.816247:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787759132.816337:0:5816:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf2d5941 from MGS, refs=2 00080000:01000000:1.0:1787759132.816342:0:5816:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787759132.816347:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf2aa 00000100:00100000:1.0:1787759132.816454:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787759132.816584:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787759132.816590:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787759132.816941:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787759132.816949:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787759132.817439:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787759132.817564:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787759132.817570:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787759132.817916:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787759132.817924:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787759132.818108:0:5816:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787759132.818113:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787759132.818456:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759132.818459:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759132.818461:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759132.818585:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759132.818588:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759132.818589:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759132.818878:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787759132.820543:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787759133.068488:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 6495 MB/s 00000001:01000000:1.0:1787759133.318506:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7815 MB/s 00000001:01000000:1.0:1787759133.568546:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1415 MB/s 00000001:01000000:1.0:1787759133.818658:0:5816:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1727 MB/s 00080000:10000000:1.0:1787759133.823667:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787759133.832049:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787759133.832064:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787759133.832066:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787759133.833073:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787759133.833110:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787759133.833158:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787759133.833482:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787759133.833519:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787759133.835189:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.835477:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787759133.835484:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787759133.836291:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787759133.836299:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787759133.836826:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787759133.836833:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787759133.837540:0:5831:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787759133.837583:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787759133.837602:0:5816:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.138@tcp' 00000020:01000004:0.0:1787759133.837604:0:5816:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787759133.837660:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.138@tcp (typ=mgc) 00000020:00000080:0.0:1787759133.837682:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.138@tcp (0000000012d2549a) 00000020:00000080:0.0:1787759133.837698:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787759133.837860:0:5816:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000043332069@MGC192.168.204.138@tcp: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1787759133.838077:0:5816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.138@tcp-0 is initialized 00000040:01000000:0.0:1787759133.838085:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 1 is initialized 00010000:00010000:1.0:1787759133.838553:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787759133.839497:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787759133.839532:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.138@tcp (uuid 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6) 00000020:00000080:0.0:1787759133.839550:0:5816:0:(genops.c:1385:class_connect()) connect: client 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6, cookie 0x662cc405a6abf2b8 00000100:00080000:0.0:1787759133.839562:0:5816:0:(import.c:510:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787759133.839567:0:5816:0:(import.c:624:import_select_connection()) MGC192.168.204.138@tcp: import 0000000043332069 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1787759133.839602:0:5816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000357f09cb x1874601293381760/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787759133.839627:0:5816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS 00000020:01000004:0.0:1787759133.839646:0:5816:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787759133.839652:0:5816:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787759133.839664:0:5816:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005313df7c) 00000020:00000080:0.0:1787759133.839679:0:5816:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787759133.839786:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000357f09cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3302:1874601293381760:0@lo:250: 00000100:00100000:2.0:1787759133.839925:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759133.840033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293381760 00000100:00100000:2.0:1787759133.840043:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293381760 00000100:00100000:2.0:1787759133.840079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759133.840087:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036a53bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874601293381760:12345-0@lo:250: 00010000:00080000:2.0:1787759133.840120:0:5828:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6@0@lo t0 exp 0000000000000000 cur 98 last 0 00000020:00000080:2.0:1787759133.840151:0:5828:0:(genops.c:1385:class_connect()) connect: client 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6, cookie 0x662cc405a6abf2c6 00000100:00080000:2.0:1787759133.840354:0:5828:0:(import.c:65:import_set_state_nolock()) 00000000ac9f0da0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787759133.840456:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036a53bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:3302:x1874601293381760:12345-0@lo:250: Request processed in 368us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759133.840488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759133.840551:0:3302:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787759133.840562:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1787759133.840571:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787759133.840576:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787759133.840580:0:3302:0:(import.c:65:import_set_state_nolock()) 0000000043332069 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787759133.840583:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787759133.840592:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787759133.840598:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000357f09cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3302:1874601293381760:0@lo:250: 00000100:00100000:0.0:1787759133.845980:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.846222:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787759133.846228:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787759133.847128:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787759133.847136:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787759133.847565:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787759133.847582:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787759133.850375:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.850619:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787759133.850627:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787759133.852537:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787759133.852555:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787759133.875042:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759133.875251:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787759133.875257:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787759133.876509:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787759133.876518:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787759133.877103:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759133.877242:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787759133.877247:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787759133.877715:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787759133.877721:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787759133.878579:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.878798:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787759133.878812:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787759133.879219:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787759133.879225:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787759133.879953:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.880132:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787759133.880138:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787759133.880699:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787759133.880707:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787759133.894349:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759133.894579:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787759133.894585:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787759133.896098:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787759133.896108:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787759133.897166:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787759133.897174:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787759133.898299:0:5816:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787759133.898330:0:5816:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787759133.898334:0:5816:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787759133.898511:0:5816:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787759133.898561:0:5816:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787759133.898566:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787759133.898568:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787759133.898569:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759133.898570:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759133.898571:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759133.898572:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759133.898573:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787759133.898574:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787759133.898576:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759133.898577:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759133.898579:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759133.898581:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787759133.898583:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787759133.898585:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787759133.898586:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787759133.898588:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759133.898589:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759133.898590:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759133.898591:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759133.898592:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787759133.898593:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787759133.898594:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759133.898595:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759133.898596:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759133.898597:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787759133.898621:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787759133.898636:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293381888:0@lo:253: 00000100:00100000:0.0:1787759133.898722:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759133.898771:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293381888 00000100:00100000:3.0:1787759133.898778:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293381888 00000100:00100000:0.0:1787759133.898794:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000085fa77ec going to sleep for 11 seconds 00000100:00100000:3.0:1787759133.898838:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759133.898846:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5259ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5816:x1874601293381888:12345-0@lo:253: 20000000:01000000:3.0:1787759133.898903:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787759133.898907:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787759133.899210:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787759133.899293:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787759133.899579:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787759133.900415:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787759133.900530:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787759133.900534:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787759133.900539:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787759133.900542:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787759133.900555:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787759133.900678:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759133.900853:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787759133.900865:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787759133.900925:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787759133.900966:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787759133.900996:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787759133.901068:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787759133.901076:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787759133.901110:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787759133.901117:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787759133.901141:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787759133.901147:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787759133.901172:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787759133.901226:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787759133.901250:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787759133.901254:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787759133.901263:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759133.901436:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787759133.901445:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787759133.901472:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787759133.901502:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787759133.901538:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787759133.901548:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787759133.901615:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787759133.901623:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787759133.901689:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787759133.901731:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787759133.901766:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787759133.901776:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787759133.901854:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787759133.901863:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787759133.901910:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787759133.901954:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787759133.902134:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787759133.902198:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787759133.902206:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787759133.903023:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787759133.903519:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787759133.903551:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.138@tcp for mdt 20000000:01000000:3.0:1787759133.903554:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:3.0:1787759133.903587:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787759133.903594:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787759133.903628:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787759133.903639:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:3.0:1787759133.903688:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787759133.903699:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787759133.903729:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787759133.903762:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787759133.903818:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787759133.903821:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787759133.903827:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787759133.903834:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787759133.904395:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1787759133.904452:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787759133.909023:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787759133.909078:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1787759133.909151:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1787759133.909181:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787759133.909182:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787759133.909185:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787759133.909208:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787759133.909209:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787759133.909233:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787759133.909234:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787759133.909985:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787759133.910316:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787759133.910347:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787759133.910418:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1787759133.910428:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787759133.910430:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787759133.910803:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787759133.911071:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787759133.911105:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787759133.911139:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1787759133.911147:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759133.911149:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787759133.911154:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787759133.911170:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911182:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911189:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911192:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911195:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911209:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911219:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d6969cf already unused, calling callback (0000000099018a47) 00010000:00010000:3.0:1787759133.911222:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911227:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911236:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911241:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.911244:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d6969cf/0x662cc405a6abf2cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787759133.911256:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787759133.994768:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5259ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5816:x1874601293381888:12345-0@lo:253: Request processed in 95915us (96040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759133.994783:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787759133.994946:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293381888:0@lo:253: 10000000:01000000:0.0:1787759133.994962:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787759133.994965:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787759133.994967:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787759133.994968:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759133.994970:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787759133.994971:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759133.994972:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759133.994973:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787759133.994974:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787759133.994976:0:5816:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787759133.994977:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759133.994978:0:5816:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787759133.994997:0:5816:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bf2d5941 from lustre-MDT0000 10000000:01000000:0.0:1787759133.995021:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787759133.995024:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787759133.995028:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d7746458000 10000000:01000000:0.0:1787759133.995032:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787759133.995038:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7746458000 from 1 10000000:01000000:0.0:1787759133.995041:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759133.995074:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759133.995084:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759133.995093:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759133.995109:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382016:0@lo:101: 00000100:00100000:0.0:1787759133.995167:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759133.995263:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382016 00000100:00100000:0.0:1787759133.995267:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:2.0:1787759133.995269:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382016 00000100:00100000:2.0:1787759133.995337:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787759133.995347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b46b078c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5816:x1874601293382016:12345-0@lo:101: 00010000:00010000:2.0:1787759133.995360:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759133.995399:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf2d4 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.995420:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.995431:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.995446:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cb911fb, rc 0) 00000100:00100000:2.0:1787759133.995482:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b46b078c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+6:5816:x1874601293382016:12345-0@lo:101: Request processed in 138us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759133.995489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787759133.995519:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382016:0@lo:101: 00010000:00010000:0.0:1787759133.995531:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759133.995539:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759133.995575:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382144:0@lo:501: 00000100:00100000:0.0:1787759133.995593:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759133.995612:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:3.0:1787759133.995656:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382144 00000100:00100000:3.0:1787759133.995661:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382144 00000100:00100000:3.0:1787759133.995724:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759133.995731:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000965af09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+6:5816:x1874601293382144:12345-0@lo:501: 00000100:00100000:3.0:1787759133.995906:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000965af09e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+6:5816:x1874601293382144:12345-0@lo:501: Request processed in 175us (311us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787759133.995913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759133.995938:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000007c4579 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382144:0@lo:501: 10000000:01000000:2.0:1787759133.995963:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787759133.995978:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.995985:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759133.995993:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7758776000 10000000:01000000:2.0:1787759133.995997:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787759133.996001:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d7758776000 10000000:01000000:2.0:1787759133.996004:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787759133.996007:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d7758776000 from 1 10000000:01000000:2.0:1787759133.996010:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787759133.996026:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996033:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996039:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759133.996050:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000587d34ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382272:0@lo:101: 00000100:00100000:2.0:1787759133.996082:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759133.996106:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099e2a4a8 going to sleep for 11 seconds 00000100:00100000:1.0:1787759133.996161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382272 00000100:00100000:1.0:1787759133.996166:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382272 00000100:00100000:1.0:1787759133.996194:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787759133.996200:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7428a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+6:5816:x1874601293382272:12345-0@lo:101: 00010000:00010000:1.0:1787759133.996207:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759133.996217:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a474ac42/0x662cc405a6abf2e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf2e2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759133.996233:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a474ac42/0x662cc405a6abf2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf2e2 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759133.996241:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a474ac42/0x662cc405a6abf2e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf2e2 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759133.996259:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a474ac42, rc 0) 00000100:00100000:1.0:1787759133.996295:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7428a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:5816:x1874601293382272:12345-0@lo:101: Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759133.996302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787759133.996327:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000587d34ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382272:0@lo:101: 00010000:00010000:2.0:1787759133.996337:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996343:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759133.996354:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787759133.996363:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996392:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000003bea67cc/0x662cc405a6abf2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759133.996396:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787759133.996399:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787759133.996402:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d7758776000 10000000:01000000:2.0:1787759133.996404:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787759133.996405:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787759133.996407:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787759133.996466:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.996479:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.996487:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759133.996499:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000587d34ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382400:0@lo:101: 00000100:00100000:3.0:1787759133.996524:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759133.996549:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c269e834 going to sleep for 11 seconds 00000100:00100000:2.0:1787759133.996590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382400 00000100:00100000:2.0:1787759133.996593:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382400 00000100:00100000:2.0:1787759133.996613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787759133.996618:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d515b6ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:5816:x1874601293382400:12345-0@lo:101: 00010000:00010000:2.0:1787759133.996624:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759133.996631:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf2f0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996654:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996661:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759133.996667:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038386cf9, rc 0) 00000100:00100000:2.0:1787759133.996734:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d515b6ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:5816:x1874601293382400:12345-0@lo:101: Request processed in 116us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759133.996740:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759133.996785:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000587d34ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382400:0@lo:101: 00010000:00010000:3.0:1787759133.996794:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759133.996801:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759133.996836:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382528:0@lo:501: 00000100:00100000:3.0:1787759133.996858:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759133.996896:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c269e834 going to sleep for 11 seconds 00000100:00100000:1.0:1787759133.996941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382528 00000100:00100000:1.0:1787759133.996945:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382528 00000100:00100000:1.0:1787759133.996971:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787759133.996977:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000140c9c2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:5816:x1874601293382528:12345-0@lo:501: 00000100:00100000:1.0:1787759133.997217:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000140c9c2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5816:x1874601293382528:12345-0@lo:501: Request processed in 240us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759133.997224:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759133.997248:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382528:0@lo:501: 00000100:00100000:3.0:1787759133.997273:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382656:0@lo:503: 00000100:00100000:3.0:1787759133.997309:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759133.997356:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c269e834 going to sleep for 11 seconds 00000100:00100000:2.0:1787759133.997400:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382656 00000100:00100000:2.0:1787759133.997404:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382656 00000100:00100000:2.0:1787759133.997423:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787759133.997428:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ee1f9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5816:x1874601293382656:12345-0@lo:503: 00000100:00100000:2.0:1787759133.997602:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ee1f9db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5816:x1874601293382656:12345-0@lo:503: Request processed in 174us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759133.997607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759133.997654:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293382656:0@lo:503: 00000100:00100000:0.0:1787759133.997962:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5858:1874601293382784:0@lo:502: 00000100:00100000:0.0:1787759133.997994:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759133.998018:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d45ecaf going to sleep for 11 seconds 00000100:00100000:1.0:1787759133.998160:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382784 00000100:00100000:1.0:1787759133.998164:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382784 00000100:00100000:1.0:1787759133.998184:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787759133.998190:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d203bd17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5858:x1874601293382784:12345-0@lo:502: 00000100:00100000:1.0:1787759133.998438:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d203bd17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5858:x1874601293382784:12345-0@lo:502: Request processed in 248us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759133.998445:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787759133.998456:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5858:1874601293382784:0@lo:502: 00000020:01000000:0.0:1787759133.998476:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759133.998485:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759133.998488:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787759133.998492:0:5858:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787759133.998495:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787759133.998507:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003be2797b) 00000020:00000080:0.0:1787759133.998526:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787759133.998531:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787759133.998594:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787759133.998608:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf305 00000020:00000080:0.0:1787759133.998780:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787759133.998784:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759133.998789:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759133.998790:0:5858:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787759133.998792:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759133.998794:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759133.998795:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787759133.998797:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787759133.998802:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000005eb7e1a) 00000020:00000080:0.0:1787759133.998809:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787759133.998811:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787759133.998812:0:5858:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787759133.998814:0:5858:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787759133.998818:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787759133.998854:0:5858:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf2d5941 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787759133.998882:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000242a12c0) 00000020:00000080:0.0:1787759133.998890:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787759133.998933:0:5858:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787759133.998938:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x662cc405a6abf31a 00000020:00000080:0.0:1787759133.999041:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787759133.999047:0:5858:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787759133.999051:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x662cc405a6abf321 00080000:01000000:0.0:1787759133.999056:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787759133.999059:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf328 00080000:10000000:0.0:1787759133.999419:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787759133.999621:0:5858:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787759134.002541:0:5858:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1787759134.046844:0:5858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1787759134.047136:0:5858:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1787759134.048821:0:5858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1787759134.048997:0:5858:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787759134.059973:0:5858:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d946913e) 00000020:00000080:2.0:1787759134.059993:0:5858:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787759134.060062:0:5858:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787759134.060078:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf336 00000020:00000080:2.0:1787759134.060586:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787759134.062258:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.075277:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.086189:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.099525:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759134.114454:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787759134.133010:0:5858:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787759134.145968:0:5858:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x662cc405a6abf33d 00000020:00000080:3.0:1787759134.146362:0:5858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787759134.146406:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759134.146411:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759134.146413:0:5858:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787759134.146417:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759134.146421:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759134.146422:0:5858:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787759134.146425:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787759134.146454:0:5858:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787759134.146469:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759134.146471:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759134.146472:0:5858:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787759134.146473:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759134.146475:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759134.146475:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759134.146477:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759134.146478:0:5858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787759134.146520:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5858:1874601293382912:0@lo:502: 00000100:00100000:3.0:1787759134.146584:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.146640:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dde5fa84 going to sleep for 11 seconds 00000100:00100000:2.0:1787759134.146644:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293382912 00000100:00100000:2.0:1787759134.146658:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293382912 00000100:00100000:2.0:1787759134.146704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759134.146711:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031b97bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5858:x1874601293382912:12345-0@lo:502: 00000100:00100000:2.0:1787759134.147064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031b97bfa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5858:x1874601293382912:12345-0@lo:502: Request processed in 353us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759134.147072:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759134.147100:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5858:1874601293382912:0@lo:502: 00000020:01000000:3.0:1787759134.147126:0:5858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759134.147129:0:5858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759134.147130:0:5858:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759134.147133:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787759134.147306:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787759134.147325:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787759134.147340:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.147350:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759134.147467:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d7758776000 from 1 10000000:01000000:0.0:1787759134.147470:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787759134.147495:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.147502:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.147511:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759134.147524:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383040:0@lo:101: 00000100:00100000:0.0:1787759134.147555:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759134.147579:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb084e83 going to sleep for 11 seconds 00000100:00100000:1.0:1787759134.147598:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383040 00000100:00100000:1.0:1787759134.147604:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383040 00000100:00100000:1.0:1787759134.147636:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787759134.147642:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000307f1f55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:5816:x1874601293383040:12345-0@lo:101: 00010000:00010000:1.0:1787759134.147650:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759134.147661:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf344 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.147680:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf344 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.147690:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf344 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.147699:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdaeaaa8, rc 0) 00000100:00100000:1.0:1787759134.147734:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000307f1f55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:5816:x1874601293383040:12345-0@lo:101: Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759134.147740:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787759134.147773:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383040:0@lo:101: 00010000:00010000:0.0:1787759134.147786:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.147794:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759134.148452:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383168:0@lo:256: 00000100:00100000:0.0:1787759134.148488:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759134.148511:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb084e83 going to sleep for 11 seconds 00000100:00100000:2.0:1787759134.148598:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383168 00000100:00100000:2.0:1787759134.148603:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383168 00000100:00100000:2.0:1787759134.148631:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787759134.148638:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6fa1c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:5816:x1874601293383168:12345-0@lo:256: 20000000:01000000:2.0:1787759134.148654:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787759134.148659:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787759134.148731:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6fa1c76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:5816:x1874601293383168:12345-0@lo:256: Request processed in 93us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759134.148739:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787759134.148751:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383168:0@lo:256: 10000000:01000000:0.0:1787759134.149424:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787759134.149441:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.149455:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759134.149462:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7758776000 from 1 10000000:01000000:0.0:1787759134.149464:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787759134.149480:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.149487:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.149494:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759134.149504:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383296:0@lo:101: 00000100:00100000:0.0:1787759134.149532:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759134.149563:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb084e83 going to sleep for 11 seconds 00000100:00100000:2.0:1787759134.149631:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383296 00000100:00100000:2.0:1787759134.149636:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383296 00000100:00100000:2.0:1787759134.149701:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787759134.149708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007807b35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:5816:x1874601293383296:12345-0@lo:101: 00010000:00010000:2.0:1787759134.149716:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759134.149739:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf352 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.149755:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.149763:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.149779:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086128653, rc 0) 00000100:00100000:2.0:1787759134.149846:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007807b35b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383296:12345-0@lo:101: Request processed in 139us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759134.149852:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759134.149917:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9672b77 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383296:0@lo:101: 00010000:00010000:3.0:1787759134.149928:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759134.149935:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759134.149978:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383424:0@lo:501: 00000100:00100000:3.0:1787759134.150001:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.150022:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dde5fa84 going to sleep for 11 seconds 00000100:00100000:0.0:1787759134.150072:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383424 00000100:00100000:0.0:1787759134.150076:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383424 00000100:00100000:0.0:1787759134.150100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787759134.150105:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000581a111d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383424:12345-0@lo:501: 00000100:00100000:0.0:1787759134.150555:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000581a111d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383424:12345-0@lo:501: Request processed in 449us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759134.150562:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759134.150786:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383424:0@lo:501: 00000100:00100000:3.0:1787759134.150822:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383552:0@lo:503: 00000100:00100000:3.0:1787759134.150854:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.150886:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dde5fa84 going to sleep for 11 seconds 00000100:00100000:1.0:1787759134.150912:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383552 00000100:00100000:1.0:1787759134.150917:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383552 00000100:00100000:1.0:1787759134.150994:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759134.151003:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a66f49b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383552:12345-0@lo:503: 00000040:00080000:1.0:1787759134.151040:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787759134.151095:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a66f49b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383552:12345-0@lo:503: Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759134.151105:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000734bbfbc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383552:0@lo:503: 00000100:00100000:1.0:1787759134.151106:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:2.0:1787759134.152118:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787759134.152280:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787759134.152297:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759134.152318:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759134.152328:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759134.152457:0:5816:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787759134.152460:0:5816:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7758776000 10000000:01000000:3.0:1787759134.152463:0:5816:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7758776000 10000000:01000000:3.0:1787759134.152467:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787759134.152472:0:5816:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7758776000 from 1 10000000:01000000:3.0:1787759134.152474:0:5816:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759134.152499:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759134.152506:0:5816:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759134.152528:0:5816:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759134.152545:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383680:0@lo:101: 00000100:00100000:3.0:1787759134.152586:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.152617:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d7373e going to sleep for 11 seconds 00000100:00100000:1.0:1787759134.152633:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383680 00000100:00100000:1.0:1787759134.152639:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383680 00000100:00100000:1.0:1787759134.152682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759134.152689:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d3ca5d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293383680:12345-0@lo:101: 00010000:00010000:1.0:1787759134.152700:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759134.152717:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf360 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.152737:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf360 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.152747:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf360 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.152756:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a1fa98b, rc 0) 00000100:00100000:1.0:1787759134.152797:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d3ca5d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293383680:12345-0@lo:101: Request processed in 109us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759134.152803:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787759134.152835:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383680:0@lo:101: 00010000:00010000:3.0:1787759134.152844:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759134.152850:0:5816:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759134.152909:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383808:0@lo:501: 00000100:00100000:3.0:1787759134.152933:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.152950:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d7373e going to sleep for 11 seconds 00000100:00100000:0.0:1787759134.152968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383808 00000100:00100000:0.0:1787759134.152972:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383808 00000100:00100000:0.0:1787759134.153003:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787759134.153009:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e4b9e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293383808:12345-0@lo:501: 00000100:00100000:0.0:1787759134.153230:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e4b9e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293383808:12345-0@lo:501: Request processed in 221us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759134.153237:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787759134.153253:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383808:0@lo:501: 00000100:00100000:3.0:1787759134.153275:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383936:0@lo:503: 00000100:00100000:3.0:1787759134.153306:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759134.153320:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011d7373e going to sleep for 11 seconds 00000100:00100000:1.0:1787759134.153343:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293383936 00000100:00100000:1.0:1787759134.153348:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293383936 00000100:00100000:1.0:1787759134.153398:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787759134.153405:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fff3de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293383936:12345-0@lo:503: 00000100:00100000:1.0:1787759134.153836:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fff3de1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293383936:12345-0@lo:503: Request processed in 432us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759134.153844:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759134.153858:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001eeedff9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293383936:0@lo:503: 00000100:00100000:1.0:1787759134.154098:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab592bd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5863:1874601293384064:0@lo:502: 00000100:00100000:1.0:1787759134.154131:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759134.154156:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec0e9a50 going to sleep for 11 seconds 00000100:00100000:0.0:1787759134.154168:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384064 00000100:00100000:0.0:1787759134.154174:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384064 00000100:00100000:0.0:1787759134.154215:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759134.154221:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c1e724 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5863:x1874601293384064:12345-0@lo:502: 00000100:00100000:0.0:1787759134.154411:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c1e724 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5863:x1874601293384064:12345-0@lo:502: Request processed in 189us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759134.154418:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787759134.154561:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab592bd3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5863:1874601293384064:0@lo:502: 00000020:01000004:1.0:1787759134.154730:0:5863:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787759134.154744:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006d3f9109) 00000020:00000080:1.0:1787759134.154762:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787759134.154832:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bf2d5941 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787759134.154843:0:5863:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bf2d5941 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787759134.154845:0:5863:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bf2d5941 4 00010000:00080000:1.0:1787759134.154892:0:5863:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c0947502@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1787759134.156792:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787759134.156980:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787759134.157008:0:5863:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787759134.157020:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x662cc405a6abf375 00000100:00080000:1.0:1787759134.157029:0:5863:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787759134.157034:0:5863:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c0947502 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1787759134.157063:0:5863:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ab592bd3 x1874601293384192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787759134.157089:0:5863:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787759134.157120:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab592bd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293384192:0@lo:38: 00000100:00100000:3.0:1787759134.157184:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759134.157256:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384192 00000100:00100000:0.0:1787759134.157263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384192 00000100:00100000:0.0:1787759134.157295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759134.157301:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eeedff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874601293384192:12345-0@lo:38: 00000100:00100000:0.0:1787759134.157363:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eeedff9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874601293384192:12345-0@lo:38: Request processed in 61us (179us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787759134.157418:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787759134.157423:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000c0947502 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787759134.157433:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787759134.157435:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab592bd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293384192:0@lo:38: 00000100:00100000:0.0:1787759134.157461:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759134.159854:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e722c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5863:1874601293384320:0@lo:502: 00000100:00100000:1.0:1787759134.159935:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759134.159979:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061226cd2 going to sleep for 11 seconds 00000100:00100000:2.0:1787759134.160031:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384320 00000100:00100000:2.0:1787759134.160038:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384320 00000100:00100000:2.0:1787759134.160113:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787759134.160122:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025752b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5863:x1874601293384320:12345-0@lo:502: 00000100:00100000:2.0:1787759134.160402:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025752b2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5863:x1874601293384320:12345-0@lo:502: Request processed in 281us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759134.160412:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787759134.160443:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e722c4b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5863:1874601293384320:0@lo:502: 00000040:00080000:3.0:1787759134.160473:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787759134.160548:0:5816:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787759134.160571:0:5816:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787759134.160618:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.160629:0:5816:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787759134.160671:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787759134.160673:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787759134.160675:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759134.160676:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759134.160677:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759134.160679:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759134.160680:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787759134.160682:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787759134.160683:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759134.160689:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759134.160691:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759134.160692:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787759134.160695:0:5816:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787759134.160698:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787759134.160699:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787759134.160700:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759134.160701:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759134.160702:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759134.160703:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759134.160704:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787759134.160705:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787759134.160706:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759134.160706:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759134.160707:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759134.160708:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787759134.160721:0:5816:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787759134.160729:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098afa28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293384448:0@lo:253: 00000100:00100000:2.0:1787759134.160768:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759134.160799:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5e632f2 going to sleep for 11 seconds 00000100:00100000:3.0:1787759134.160809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384448 00000100:00100000:3.0:1787759134.160815:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384448 00000100:00100000:3.0:1787759134.160845:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787759134.160851:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8a9836c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5816:x1874601293384448:12345-0@lo:253: 20000000:01000000:3.0:1787759134.160884:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787759134.160896:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787759134.175302:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787759134.175349:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787759134.175459:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787759134.175465:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787759134.175485:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.175511:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf344 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.175522:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.175558:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.175572:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 12 pid: 5829 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759134.175598:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e778e35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874601293384576:0@lo:104: 00000100:00100000:2.0:1787759134.175662:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759134.175750:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd3033d4 going to sleep for 11 seconds 00000100:00100000:1.0:1787759134.175812:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384576 00000100:00100000:1.0:1787759134.175819:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384576 00000100:00100000:1.0:1787759134.175906:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759134.175915:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acdfcf1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5851:x1874601293384576:12345-0@lo:104: 00010000:00010000:1.0:1787759134.175926:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759134.175989:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787759134.175996:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acdfcf1e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5851:x1874601293384576:12345-0@lo:104: Request processed in 83us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759134.176005:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759134.176032:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e778e35 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874601293384576:0@lo:104: 00010000:00010000:0.0:1787759134.176052:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176058:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759134.176064:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176072:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004a1320bf already unused, calling callback (00000000bf36c431) 10000000:00010000:2.0:1787759134.176076:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176083:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759134.176089:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759134.176095:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787759134.176129:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176137:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759134.176160:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176166:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000004a1320bf/0x662cc405a6abf344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf34b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176181:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759134.176188:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759134.176189:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759134.176233:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787759134.176242:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023f618cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293384704:0@lo:103: 00000100:00100000:2.0:1787759134.176275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759134.176328:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384704 00000100:00100000:0.0:1787759134.176333:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384704 00010000:00010000:0.0:1787759134.176354:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 13 pid: 5829 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759134.176415:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759134.176425:0:5821:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787759134.176431:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d055ec1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3303:x1874601293384704:12345-0@lo:103: 00000100:00100000:2.0:1787759134.176435:0:5821:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1787759134.176446:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759134.176451:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 13 pid: 5829 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176462:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 13 pid: 5829 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176475:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdaeaaa8/0x662cc405a6abf34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf344 expref: 13 pid: 5829 timeout: 248 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176487:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176494:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787759134.176507:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001043036s 00010000:00010000:0.0:1787759134.176510:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176515:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176519:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176522:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176525:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000060cb3de0 already unused, calling callback (0000000099018a47) 00010000:00010000:0.0:1787759134.176534:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176541:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176560:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759134.176569:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759134.176585:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176594:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759134.176599:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000060cb3de0/0x662cc405a6abf37c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759134.176611:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d055ec1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3303:x1874601293384704:12345-0@lo:103: Request processed in 181us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759134.176620:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759134.176653:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023f618cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293384704:0@lo:103: 00000100:00100000:2.0:1787759134.179027:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8a9836c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5816:x1874601293384448:12345-0@lo:253: Request processed in 18171us (18254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759134.179039:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787759134.179047:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098afa28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5816:1874601293384448:0@lo:253: 10000000:01000000:3.0:1787759134.179062:0:5816:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787759134.179066:0:5816:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759134.179068:0:5816:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787759134.179069:0:5816:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759134.179071:0:5816:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759134.179072:0:5816:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759134.179074:0:5816:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759134.179075:0:5816:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787759134.179076:0:5816:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787759134.179078:0:5816:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759134.179079:0:5816:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759134.179081:0:5816:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759134.179082:0:5816:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787759134.179093:0:5816:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787759134.183032:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787759134.183580:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759134.184238:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.184481:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759134.184702:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.184896:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759134.185802:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.185986:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759134.186314:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.186767:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759134.187058:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759134.187264:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787759134.201472:0:5816:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787759134.214147:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787759134.214152:0:5869:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787759134.214157:0:5869:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787759134.214341:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787759134.217135:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787759134.217630:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787759134.218064:0:5816:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787759134.218071:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787759134.218280:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787759134.219230:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787759134.219783:0:5816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787759134.219824:0:5816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787759134.220047:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787759134.220323:0:5816:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787759134.221825:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787759134.221988:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787759134.222169:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787759134.222396:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787759134.222636:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787759134.222887:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787759134.223084:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787759134.223357:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787759134.223611:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787759134.223789:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787759134.224011:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787759134.224225:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787759134.224525:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787759134.224813:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787759134.225060:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787759134.225296:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787759134.225884:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787759134.226133:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787759134.226429:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787759134.226669:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787759134.226906:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787759134.227150:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787759134.227356:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787759134.227534:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787759134.227679:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787759134.227825:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787759134.227988:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787759134.228135:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787759134.228286:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787759134.228535:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787759134.228780:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787759134.229011:0:5816:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787759134.229253:0:5816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787759134.230181:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787759134.248959:0:5816:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787759134.248997:0:5816:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f6741c8f988 00100000:10000000:1.0:1787759134.249005:0:5816:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787759134.249607:0:5816:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787759134.249622:0:5816:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787759134.249636:0:5816:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1787759134.249707:0:5816:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787759134.251110:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787759134.251160:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787759134.251164:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787759134.863271:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759135.886709:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759135.967227:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787759136.910537:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759137.935489:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787759138.571563:0:6313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee4f0e4b0 20000000:00000080:1.0:1787759138.571586:0:6313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d7747dd4800 uarg=0000000000000000 20000000:01000000:1.0:1787759138.571629:0:6313:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787759138.571638:0:6313:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787759138.571644:0:6313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787759138.571901:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787759138.571915:0:6313:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787759138.578752:0:6313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787759138.579282:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787759138.579340:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787759138.579440:0:6313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787759138.579463:0:6313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787759138.579486:0:6313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.579507:0:6313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf352 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.579517:0:6313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.579563:0:6313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.579593:0:6313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 10 pid: 5829 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759138.579609:0:6313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be80bb5a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1874601293384832:0@lo:104: 00000100:00100000:1.0:1787759138.579691:0:6313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759138.579844:0:6313:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099b8e63b going to sleep for 11 seconds 00000100:00100000:2.0:1787759138.580048:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384832 00000100:00100000:2.0:1787759138.580057:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384832 00000100:00100000:2.0:1787759138.580121:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759138.580130:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787759138.580135:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b2d2a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:6313:x1874601293384832:12345-0@lo:104: 00000100:00100000:1.0:1787759138.580142:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1787759138.580152:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580235:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759138.580242:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b2d2a8f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:6313:x1874601293384832:12345-0@lo:104: Request processed in 112us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759138.580251:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759138.580264:0:6313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be80bb5a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6313:1874601293384832:0@lo:104: 00010000:00010000:0.0:1787759138.580283:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759138.580292:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.580296:0:6313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759138.580310:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d7b5137 already unused, calling callback (00000000bf36c431) 10000000:00010000:0.0:1787759138.580315:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759138.580324:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759138.580331:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759138.580338:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759138.580403:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759138.580418:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759138.580445:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759138.580452:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000005d7b5137/0x662cc405a6abf352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf359 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759138.580470:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759138.580472:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759138.580473:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759138.580524:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a823cfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293384960:0@lo:103: 00000100:00100000:1.0:1787759138.580564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759138.580607:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293384960 00000100:00100000:2.0:1787759138.580613:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293384960 00010000:00010000:2.0:1787759138.580630:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759138.580658:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759138.580664:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be80bb5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:3305:x1874601293384960:12345-0@lo:103: 00010000:00010000:2.0:1787759138.580674:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759138.580679:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580689:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580707:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086128653/0x662cc405a6abf359 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf352 expref: 11 pid: 5829 timeout: 252 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580723:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580731:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580744:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580751:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580758:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580764:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.580770:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067961080 already unused, calling callback (0000000099018a47) 00010000:00010000:2.0:1787759138.580774:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.581165:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.581188:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759138.581209:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759138.581252:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be80bb5a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:3305:x1874601293384960:12345-0@lo:103: Request processed in 589us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759138.581260:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787759138.581321:0:6313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.581328:0:6313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759138.581334:0:6313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067961080/0x662cc405a6abf383 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759138.581349:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a823cfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293384960:0@lo:103: 00010000:00010000:3.0:1787759138.958610:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787759139.662511:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787759139.662519:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787759139.662523:0:38:0:(import.c:65:import_set_state_nolock()) 00000000c0947502 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787759139.662538:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c0947502 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1787759139.662553:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293385088:0@lo:400: 00000100:00100000:3.0:1787759139.662564:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005ce717c5 x1874601293385216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787759139.662633:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ce717c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293385216:0@lo:38: 00000100:00100000:2.0:1787759139.662634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759139.662729:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385088 00000100:00100000:2.0:1787759139.662736:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385088 00000100:00100000:2.0:1787759139.662796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787759139.662806:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be074a7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:3306:x1874601293385088:12345-0@lo:400: 00000100:00100000:3.0:1787759139.662935:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759139.662940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be074a7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:3306:x1874601293385088:12345-0@lo:400: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759139.662949:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787759139.663009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385216 00000100:00100000:2.0:1787759139.663013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385216 00000100:00100000:2.0:1787759139.663038:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759139.663043:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734bbfbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874601293385216:12345-0@lo:38: 00010000:00080000:2.0:1787759139.663063:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 103 last 0 00000100:00100000:0.0:1787759139.664243:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293385088:0@lo:400: 00000020:00000080:2.0:1787759139.664380:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x662cc405a6abf38a 00000004:00100000:2.0:1787759139.664423:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787759139.664585:0:5837:0:(import.c:65:import_set_state_nolock()) 00000000c39c642c : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787759139.664664:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734bbfbc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874601293385216:12345-0@lo:38: Request processed in 1619us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759139.664674:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787759139.664690:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005ce717c5 x1874601293385216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787759139.664705:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787759139.664714:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787759139.664720:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787759139.664729:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000c0947502 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787759139.664737:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ce717c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293385216:0@lo:38: 00010000:00010000:0.0:1787759139.982563:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759141.006507:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787759141.253024:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787759141.253031:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787759141.253152:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007cd950fa 00000020:01000004:2.0:1787759141.253167:0:6677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787759141.253177:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787759141.253188:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000ab5c308e) 00000020:00000080:2.0:1787759141.253201:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787759141.263776:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787759141.263971:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787759141.279515:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787759141.282991:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787759141.283011:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787759141.283053:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787759141.283084:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787759141.283400:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787759141.283408:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787759141.283415:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x662cc405a6abf398 00000020:01000004:0.0:1787759141.283421:0:6677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787759141.283437:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787759141.283439:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787759141.283442:0:6677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787759141.283445:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787759141.283457:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000d20ad356) 00000020:00000080:0.0:1787759141.283464:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787759141.284451:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787759141.284600:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787759141.284604:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787759141.285120:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787759141.285129:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787759141.285620:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787759141.285627:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787759141.287711:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787759141.287920:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787759141.287927:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787759141.290556:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787759141.290570:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787759141.303517:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759141.303751:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787759141.303756:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787759141.306030:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787759141.306044:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787759141.307715:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787759141.307724:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787759141.312216:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759141.312416:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787759141.312421:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787759141.312889:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787759141.312896:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787759141.340868:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787759141.341081:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787759141.341087:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787759141.342098:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787759141.342106:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787759141.342474:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787759141.342510:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787759141.342515:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787759141.357092:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787759141.357131:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.138@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787759141.357136:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787759141.357137:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787759141.357139:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759141.357140:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759141.357141:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759141.357142:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759141.357144:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787759141.357145:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759141.357147:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759141.357153:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759141.357154:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787759141.357157:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787759141.357160:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787759141.357161:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787759141.357162:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759141.357163:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759141.357163:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759141.357164:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759141.357165:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787759141.357165:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759141.357166:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759141.357166:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759141.357167:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787759141.357190:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787759141.357205:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098afa28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293385344:0@lo:253: 00000100:00100000:2.0:1787759141.357290:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.357443:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f33f541e going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.357516:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385344 00000100:00100000:1.0:1787759141.357524:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385344 00000100:00100000:1.0:1787759141.357611:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759141.357620:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a00cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293385344:12345-0@lo:253: 20000000:01000000:1.0:1787759141.357649:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787759141.357654:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787759141.357659:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787759141.357662:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787759141.358474:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787759141.358643:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787759141.358657:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787759141.358696:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787759141.358703:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787759141.358748:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787759141.358792:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787759141.359089:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787759141.359105:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:1.0:1787759141.359107:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787759141.359141:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787759141.359149:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787759141.359198:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787759141.359206:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1787759141.359242:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787759141.359251:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787759141.359283:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787759141.359334:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787759141.359949:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787759141.359959:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:1.0:1787759141.359964:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787759141.359989:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787759141.359993:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787759141.360009:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787759141.360013:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:1.0:1787759141.360038:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787759141.360043:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787759141.360059:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787759141.360076:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787759141.360085:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787759141.360088:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787759141.360092:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787759141.360093:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787759141.360095:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787759141.360104:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787759141.360107:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787759141.360134:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787759141.360137:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787759141.360550:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787759141.360582:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787759141.360609:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787759141.360998:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787759141.361045:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787759141.361077:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787759141.361101:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787759141.361103:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787759141.361710:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787759141.361890:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787759141.361948:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787759141.362013:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787759141.362027:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787759141.362028:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787759141.362461:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787759141.362500:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787759141.362550:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787759141.362719:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787759141.362771:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787759141.362820:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1787759141.362835:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787759141.362850:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362866:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362884:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362896:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf360 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362904:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362942:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.362954:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 10 pid: 5828 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.362966:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e778e35 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385472:0@lo:104: 00000100:00100000:2.0:1787759141.363024:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759141.363087:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385472 00000100:00100000:1.0:1787759141.363094:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385472 00010000:00010000:2.0:1787759141.363097:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.363107:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 10 pid: 5830 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.363116:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007da42a2e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385600:0@lo:104: 00000100:00100000:2.0:1787759141.363138:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759141.363164:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.363169:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385600 00010000:00010000:2.0:1787759141.363172:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 10 pid: 5829 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.363176:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385600 00000100:00100000:2.0:1787759141.363182:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007f6f3b2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385728:0@lo:104: 00000100:00100000:1.0:1787759141.363205:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759141.363225:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759141.363227:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000587d34ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293385472:12345-0@lo:104: 00000100:00100000:3.0:1787759141.363239:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fe0ca6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293385600:12345-0@lo:104: 00010000:00010000:1.0:1787759141.363250:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363251:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363346:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787759141.363351:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fe0ca6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293385600:12345-0@lo:104: Request processed in 119us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.363359:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759141.363451:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759141.363459:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787759141.363467:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000587d34ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293385472:12345-0@lo:104: Request processed in 244us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.363475:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f978739 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.363488:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787759141.363488:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787759141.363495:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363500:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000d6969cf already unused, calling callback (00000000bf36c431) 10000000:00010000:3.0:1787759141.363507:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.363509:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e778e35 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385472:0@lo:104: 00010000:00010000:3.0:1787759141.363518:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.363524:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007da42a2e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385600:0@lo:104: 10000000:00010000:3.0:1787759141.363524:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759141.363533:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759141.363558:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759141.363561:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385728 00010000:00010000:3.0:1787759141.363562:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759141.363566:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385728 00010000:00010000:3.0:1787759141.363586:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363591:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf2f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2f7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363600:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787759141.363602:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787759141.363602:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363609:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5a7f1eb already unused, calling callback (00000000bf36c431) 10000000:00010000:3.0:1787759141.363611:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759141.363615:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5963ee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293385728:12345-0@lo:104: 00010000:00010000:3.0:1787759141.363618:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.363624:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ebd72220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293385856:0@lo:103: 00010000:00010000:1.0:1787759141.363627:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759141.363645:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759141.363650:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1787759141.363658:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759141.363662:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363667:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759141.363671:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363675:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf367 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363684:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759141.363686:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759141.363689:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759141.363705:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759141.363706:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bcc4016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293385984:0@lo:103: 00000100:00100000:1.0:1787759141.363715:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5963ee3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293385728:12345-0@lo:104: Request processed in 103us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.363723:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787759141.363727:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385856 00000100:00100000:2.0:1787759141.363745:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385856 00000100:00100000:3.0:1787759141.363750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759141.363756:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787759141.363761:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.363767:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 11 pid: 5830 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.363782:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f93fba78 already unused, calling callback (00000000bf36c431) 00000100:00100000:3.0:1787759141.363783:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293385984 10000000:00010000:1.0:1787759141.363788:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.363788:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293385984 00000100:00100000:2.0:1787759141.363798:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787759141.363800:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363802:0:5866:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 12 pid: 5828 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.363809:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009481a640 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3303:x1874601293385856:12345-0@lo:103: 00010000:00010000:2.0:1787759141.363826:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:1.0:1787759141.363827:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.363833:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 12 pid: 5830 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.363838:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 10000000:01000000:1.0:1787759141.363839:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759141.363847:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ce717c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3304:x1874601293385984:12345-0@lo:103: 00010000:00010000:2.0:1787759141.363857:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 12 pid: 5830 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363857:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759141.363863:0:5866:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 12 pid: 5828 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.363874:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038386cf9/0x662cc405a6abf2f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf2f0 expref: 12 pid: 5830 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.363877:0:5866:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 12 pid: 5828 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.363882:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.363895:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787759141.363910:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.363914:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759141.363920:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000f93fba78/0x662cc405a6abf2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf2db expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.363939:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759141.363941:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759141.363944:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759141.363957:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003ac9d98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293386112:0@lo:103: 00000100:00100000:1.0:1787759141.363981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759141.363998:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759141.364002:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a1fa98b/0x662cc405a6abf367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf360 expref: 11 pid: 5828 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.364016:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759141.364042:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787759141.364045:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009481a640 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:3303:x1874601293385856:12345-0@lo:103: Request processed in 239us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759141.364055:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1787759141.364056:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759141.364058:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ce717c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:3304:x1874601293385984:12345-0@lo:103: Request processed in 210us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.364069:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759141.364087:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bcc4016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293385984:0@lo:103: 00000100:00100000:2.0:1787759141.364087:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386112 00000100:00100000:2.0:1787759141.364093:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386112 00010000:00010000:2.0:1787759141.364118:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 9 pid: 5829 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.364144:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787759141.364152:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8758132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:3305:x1874601293386112:12345-0@lo:103: 00010000:00010000:2.0:1787759141.364159:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759141.364163:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 9 pid: 5829 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364170:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 9 pid: 5829 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364181:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364189:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364200:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364207:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364212:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364218:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364222:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007889ddec already unused, calling callback (0000000099018a47) 00010000:00010000:2.0:1787759141.364225:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364237:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364255:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364264:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759141.364292:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8758132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:3305:x1874601293386112:12345-0@lo:103: Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.364299:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787759141.364308:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003ac9d98 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293386112:0@lo:103: 00000100:00100000:2.0:1787759141.364330:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ebd72220 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293385856:0@lo:103: 00010000:00010000:2.0:1787759141.364357:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008cb911fb/0x662cc405a6abf2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf2d4 expref: 8 pid: 5829 timeout: 255 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.364397:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007f6f3b2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293385728:0@lo:104: 00010000:00010000:2.0:1787759141.364413:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364420:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364425:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.364430:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007889ddec/0x662cc405a6abf3a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787759141.364440:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787759141.383881:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a00cf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:6677:x1874601293385344:12345-0@lo:253: Request processed in 26256us (26585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.383907:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787759141.383990:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098afa28b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293385344:0@lo:253: 10000000:01000000:3.0:1787759141.384005:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787759141.384008:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759141.384010:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787759141.384012:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759141.384013:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787759141.384014:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759141.384015:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759141.384017:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759141.384018:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787759141.384020:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759141.384021:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787759141.384040:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007cd950fa from lustre-OST0000 10000000:01000000:3.0:1787759141.384064:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787759141.384066:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787759141.384072:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d7746458000 local copy 10000000:01000000:3.0:1787759141.384076:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787759141.384107:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.384119:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.384134:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.384151:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386240:0@lo:101: 00000100:00100000:3.0:1787759141.384187:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.384286:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db883ef4 going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.384398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386240 00000100:00100000:2.0:1787759141.384405:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386240 00000100:00100000:2.0:1787759141.384444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787759141.384452:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010c954d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:6677:x1874601293386240:12345-0@lo:101: 00010000:00010000:2.0:1787759141.384465:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759141.384477:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007889ddec/0x662cc405a6abf3b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf3ad expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.384498:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007889ddec/0x662cc405a6abf3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf3ad expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.384508:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007889ddec/0x662cc405a6abf3b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3ad expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.384517:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007889ddec, rc 0) 00000100:00100000:2.0:1787759141.384595:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010c954d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:6677:x1874601293386240:12345-0@lo:101: Request processed in 144us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.384601:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787759141.384659:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386240:0@lo:101: 00010000:00010000:3.0:1787759141.384670:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.384677:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.384765:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386368:0@lo:501: 00000100:00100000:3.0:1787759141.384789:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.384853:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db883ef4 going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.384886:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386368 00000100:00100000:2.0:1787759141.384890:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386368 00000100:00100000:2.0:1787759141.384914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787759141.384920:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d31963de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:6677:x1874601293386368:12345-0@lo:501: 00000100:00100000:2.0:1787759141.385133:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d31963de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:6677:x1874601293386368:12345-0@lo:501: Request processed in 212us (343us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759141.385139:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787759141.385188:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386368:0@lo:501: 10000000:01000000:3.0:1787759141.385198:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787759141.385220:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787759141.385224:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.385230:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.385235:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.385256:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787759141.385285:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759141.385292:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.385301:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e5a7f1eb already unused, calling callback (00000000bf36c431) 10000000:00010000:0.0:1787759141.385303:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.385310:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759141.385316:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759141.385321:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787759141.385328:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7773d06800 10000000:01000000:3.0:1787759141.385335:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787759141.385340:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d7746458000 00010000:00010000:0.0:1787759141.385342:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759141.385344:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787759141.385350:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d7746458000 from 1 00010000:00010000:0.0:1787759141.385354:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787759141.385355:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787759141.385393:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.385401:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.385406:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.385408:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759141.385421:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097b5348d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293386496:0@lo:103: 00010000:00010000:0.0:1787759141.385424:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: 00000000e5a7f1eb/0x662cc405a6abf3ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf3b4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.385434:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386624:0@lo:101: 00010000:00010000:0.0:1787759141.385457:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759141.385460:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759141.385463:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759141.385574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.385575:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.385616:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386496 00000100:00100000:2.0:1787759141.385622:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386496 00000100:00100000:2.0:1787759141.385667:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759141.385674:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003ac9d98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:3306:x1874601293386496:12345-0@lo:103: 00010000:00010000:2.0:1787759141.385683:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759141.385693:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007889ddec/0x662cc405a6abf3b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf3ad expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.385705:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759141.385748:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003ac9d98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:3306:x1874601293386496:12345-0@lo:103: Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.385754:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759141.385785:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097b5348d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293386496:0@lo:103: 00000100:00100000:3.0:1787759141.385796:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.385836:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386624 00000100:00100000:2.0:1787759141.385839:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386624 00000100:00100000:2.0:1787759141.385866:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787759141.385871:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a3bf3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+7:6677:x1874601293386624:12345-0@lo:101: 00010000:00010000:2.0:1787759141.385877:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759141.385884:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001dc7935c/0x662cc405a6abf3c2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf3bb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.385896:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001dc7935c/0x662cc405a6abf3c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf3bb expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.385903:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001dc7935c/0x662cc405a6abf3c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3bb expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.385909:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001dc7935c, rc 0) 00000100:00100000:2.0:1787759141.386012:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a3bf3e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:6677:x1874601293386624:12345-0@lo:101: Request processed in 140us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.386018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787759141.386058:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386624:0@lo:101: 00010000:00010000:3.0:1787759141.386067:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3c2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.386074:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf3c2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759141.386086:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787759141.386096:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3c2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.386112:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 000000000d6969cf/0x662cc405a6abf3bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3c2 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759141.386119:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787759141.386123:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787759141.386126:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787759141.386128:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787759141.386140:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.386146:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.386152:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.386161:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386752:0@lo:101: 00000100:00100000:3.0:1787759141.386183:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.386229:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.386262:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386752 00000100:00100000:2.0:1787759141.386322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386752 00000100:00100000:2.0:1787759141.386345:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787759141.386349:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f6516f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+8:6677:x1874601293386752:12345-0@lo:101: 00010000:00010000:2.0:1787759141.386355:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759141.386362:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b22254d/0x662cc405a6abf3d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf3c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.386394:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b22254d/0x662cc405a6abf3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.386401:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b22254d/0x662cc405a6abf3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.386407:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b22254d, rc 0) 00000100:00100000:2.0:1787759141.386479:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f6516f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293386752:12345-0@lo:101: Request processed in 129us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.386485:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787759141.386525:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386752:0@lo:101: 00010000:00010000:3.0:1787759141.386534:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.386541:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759141.386603:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386880:0@lo:501: 00000100:00100000:3.0:1787759141.386635:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.386686:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.386722:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293386880 00000100:00100000:2.0:1787759141.386725:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293386880 00000100:00100000:2.0:1787759141.386757:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787759141.386762:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001da1c149 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293386880:12345-0@lo:501: 00000100:00100000:2.0:1787759141.386954:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001da1c149 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293386880:12345-0@lo:501: Request processed in 191us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.386961:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787759141.387006:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293386880:0@lo:501: 00000100:00100000:3.0:1787759141.387032:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387008:0@lo:503: 00000100:00100000:3.0:1787759141.387068:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.387118:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.387155:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387008 00000100:00100000:2.0:1787759141.387158:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387008 00000100:00100000:2.0:1787759141.387182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787759141.387188:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039348551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387008:12345-0@lo:503: 00000100:00100000:2.0:1787759141.387996:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039348551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387008:12345-0@lo:503: Request processed in 808us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.388008:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787759141.388022:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387008:0@lo:503: 00000040:00080000:3.0:1787759141.388292:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787759141.388338:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387136:0@lo:502: 00000100:00100000:3.0:1787759141.388432:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.388463:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:0.0:1787759141.388480:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387136 00000100:00100000:0.0:1787759141.388486:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387136 00000100:00100000:0.0:1787759141.388527:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787759141.388533:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8085fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387136:12345-0@lo:502: 00000100:00100000:0.0:1787759141.388675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8085fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387136:12345-0@lo:502: Request processed in 141us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759141.388682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787759141.388957:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387136:0@lo:502: 00000040:00080000:3.0:1787759141.389178:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787759141.389221:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787759141.389252:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787759141.389296:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787759141.389333:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787759141.389390:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787759141.389418:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387264:0@lo:502: 00000100:00100000:3.0:1787759141.389456:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.389485:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b43b446b going to sleep for 11 seconds 00000100:00100000:2.0:1787759141.389486:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387264 00000100:00100000:2.0:1787759141.389492:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387264 00000100:00100000:2.0:1787759141.389523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759141.389530:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6c70248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387264:12345-0@lo:502: 00000100:00100000:2.0:1787759141.389648:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6c70248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387264:12345-0@lo:502: Request processed in 120us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.389653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787759141.389696:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004cf06e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387264:0@lo:502: 00000040:00080000:3.0:1787759141.389797:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787759141.389807:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787759141.390524:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787759141.390532:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787759141.390543:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759141.390545:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787759141.390549:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787759141.390577:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000079ab36bd) 00000020:00000080:3.0:1787759141.390598:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787759141.390606:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787759141.390665:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007cd950fa from lustre-OST0000, refs=2 00080000:01000000:3.0:1787759141.390672:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787759141.390678:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x662cc405a6abf3de 00010000:00010000:3.0:1787759141.394506:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787759141.394805:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787759141.397164:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787759141.397479:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787759141.402406:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787759141.402905:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787759141.404079:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787759141.404091:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759141.404098:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759141.404100:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787759141.404104:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759141.404108:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759141.404110:0:6696:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759141.404114:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759141.404115:0:6696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787759141.404158:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759141.404161:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759141.404163:0:6696:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759141.404166:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787759141.404568:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787759141.404594:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787759141.404612:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.404625:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: 00000000380aeab6/0x662cc405a6abf3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759141.404633:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7773d06800 from 1 10000000:01000000:0.0:1787759141.404636:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787759141.404680:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: 00000000c30d6c9c/0x662cc405a6abf3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.404687:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: 00000000c30d6c9c/0x662cc405a6abf3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.404697:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: 00000000c30d6c9c/0x662cc405a6abf3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759141.404965:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387392:0@lo:101: 00000100:00100000:0.0:1787759141.405044:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759141.405108:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.405111:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387392 00000100:00100000:1.0:1787759141.405120:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387392 00000100:00100000:1.0:1787759141.405175:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787759141.405185:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe7a9700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+9:6677:x1874601293387392:12345-0@lo:101: 00010000:00010000:1.0:1787759141.405200:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759141.405213:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f5db46a4/0x662cc405a6abf3ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf3e5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.405237:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f5db46a4/0x662cc405a6abf3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.405246:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f5db46a4/0x662cc405a6abf3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.405254:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f5db46a4, rc 0) 00000100:00100000:1.0:1787759141.405301:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe7a9700 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387392:12345-0@lo:101: Request processed in 119us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.405308:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787759141.405422:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387392:0@lo:101: 00010000:00010000:0.0:1787759141.405435:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: 00000000c30d6c9c/0x662cc405a6abf3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.405442:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: 00000000c30d6c9c/0x662cc405a6abf3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759141.405523:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387520:0@lo:501: 00000100:00100000:0.0:1787759141.405553:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759141.405572:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.405931:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387520 00000100:00100000:1.0:1787759141.405935:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387520 00000100:00100000:1.0:1787759141.405961:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787759141.405967:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e5505ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387520:12345-0@lo:501: 00000100:00100000:1.0:1787759141.406161:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e5505ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387520:12345-0@lo:501: Request processed in 194us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.406170:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787759141.406193:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387520:0@lo:501: 00000100:00100000:0.0:1787759141.406222:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387648:0@lo:503: 00000100:00100000:0.0:1787759141.406257:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759141.406276:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.406300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387648 00000100:00100000:1.0:1787759141.406305:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387648 00000100:00100000:1.0:1787759141.406341:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787759141.406347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7285196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387648:12345-0@lo:503: 00000100:00100000:1.0:1787759141.406650:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7285196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387648:12345-0@lo:503: Request processed in 303us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.406667:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787759141.406683:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387648:0@lo:503: 00000040:00080000:0.0:1787759141.406950:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787759141.407013:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387776:0@lo:502: 00000100:00100000:0.0:1787759141.407038:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759141.407062:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff8bfcc7 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.407117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387776 00000100:00100000:1.0:1787759141.407122:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387776 00000100:00100000:1.0:1787759141.407182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787759141.407190:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf1667a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387776:12345-0@lo:502: 00000100:00100000:1.0:1787759141.407358:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf1667a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387776:12345-0@lo:502: Request processed in 169us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.407388:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787759141.407428:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000453119df pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387776:0@lo:502: 00000040:00080000:2.0:1787759141.407749:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787759141.407805:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787759141.407829:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007f6f3b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387904:0@lo:502: 00000100:00100000:2.0:1787759141.407887:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.407937:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4ac9014 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.408144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293387904 00000100:00100000:1.0:1787759141.408149:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293387904 00000100:00100000:1.0:1787759141.408183:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787759141.408190:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce77c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387904:12345-0@lo:502: 00000100:00100000:1.0:1787759141.408333:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce77c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293387904:12345-0@lo:502: Request processed in 143us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.408340:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787759141.408460:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007f6f3b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293387904:0@lo:502: 00000040:00080000:2.0:1787759141.408540:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787759141.408551:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787759141.409074:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759141.409083:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759141.409085:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787759141.409090:0:6700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7773d06800 00000020:00000080:1.0:1787759141.409092:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787759141.409138:0:6700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759141.409141:0:6700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759141.409143:0:6700:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787759141.409145:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787759141.409201:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787759141.409236:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759141.409261:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.409273:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759141.409324:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787759141.409327:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7773d06800 10000000:01000000:2.0:1787759141.409338:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7773d06800 10000000:01000000:2.0:1787759141.409342:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787759141.409347:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7773d06800 from 1 10000000:01000000:2.0:1787759141.409350:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787759141.409394:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.409403:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.409413:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.409428:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388032:0@lo:101: 00000100:00100000:2.0:1787759141.409458:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.409484:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388032 00000100:00100000:3.0:1787759141.409489:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388032 00000100:00100000:2.0:1787759141.409490:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7641804480 going to sleep for 11 seconds 00000100:00100000:3.0:1787759141.409523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787759141.409531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+10:6677:x1874601293388032:12345-0@lo:101: 00010000:00010000:3.0:1787759141.409548:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759141.409559:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf3f3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.409583:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.409593:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759141.409601:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166ee00, rc 0) 00000100:00100000:3.0:1787759141.409641:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388032:12345-0@lo:101: Request processed in 111us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.409646:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787759141.409748:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388032:0@lo:101: 00010000:00010000:2.0:1787759141.409763:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759141.409773:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759141.409833:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388160:0@lo:501: 00000100:00100000:2.0:1787759141.409853:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.409869:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7641804480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.409893:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388160 00000100:00100000:1.0:1787759141.409898:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388160 00000100:00100000:1.0:1787759141.409926:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787759141.409933:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388160:12345-0@lo:501: 00000100:00100000:1.0:1787759141.410111:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388160:12345-0@lo:501: Request processed in 177us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.410119:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787759141.410143:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388160:0@lo:501: 00000100:00100000:2.0:1787759141.410165:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388288:0@lo:503: 00000100:00100000:2.0:1787759141.410204:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.410221:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7641804480 going to sleep for 11 seconds 00000100:00100000:3.0:1787759141.410239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388288 00000100:00100000:3.0:1787759141.410244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388288 00000100:00100000:3.0:1787759141.410274:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787759141.410283:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388288:12345-0@lo:503: 00000100:00100000:3.0:1787759141.410444:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388288:12345-0@lo:503: Request processed in 163us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.410451:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787759141.410470:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388288:0@lo:503: 00000040:00080000:2.0:1787759141.410710:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787759141.410775:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388416:0@lo:502: 00000100:00100000:2.0:1787759141.410807:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.410831:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7641804480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.410843:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388416 00000100:00100000:1.0:1787759141.410849:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388416 00000100:00100000:1.0:1787759141.410877:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787759141.410886:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388416:12345-0@lo:502: 00000100:00100000:1.0:1787759141.411056:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388416:12345-0@lo:502: Request processed in 170us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759141.411064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787759141.411086:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388416:0@lo:502: 00000040:00080000:2.0:1787759141.411314:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787759141.411359:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787759141.411441:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787759141.411486:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787759141.411520:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787759141.411567:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787759141.411602:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787759141.411648:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787759141.411695:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787759141.411743:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787759141.411778:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787759141.411819:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787759141.411850:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787759141.411878:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787759141.411933:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787759141.411966:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787759141.411995:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787759141.412065:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787759141.412103:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787759141.412133:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787759141.412194:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787759141.412234:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787759141.412279:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787759141.412341:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787759141.412395:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787759141.412432:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787759141.412475:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787759141.412504:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787759141.412526:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388544:0@lo:502: 00000100:00100000:2.0:1787759141.412567:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759141.412602:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7641804480 going to sleep for 11 seconds 00000100:00100000:3.0:1787759141.412708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388544 00000100:00100000:3.0:1787759141.412714:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388544 00000100:00100000:3.0:1787759141.412759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787759141.412765:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388544:12345-0@lo:502: 00000100:00100000:0.0:1787759141.412980:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388544:0@lo:502: 00000100:00100000:3.0:1787759141.413028:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388544:12345-0@lo:502: Request processed in 261us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.413035:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000040:00080000:0.0:1787759141.413049:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787759141.413076:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787759141.413575:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787759141.413588:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d7641a68000) 00000020:00000080:3.0:1787759141.413607:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787759141.413677:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7773d06800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787759141.413681:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7773d06800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787759141.413683:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7773d06800 3 00010000:00080000:3.0:1787759141.413711:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d777c9cd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1787759141.415213:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787759141.415639:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787759141.415671:0:6701:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787759141.415682:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x662cc405a6abf408 00000100:00080000:3.0:1787759141.415694:0:6701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787759141.415702:0:6701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d777c9cd000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:3.0:1787759141.415748:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d775afc5680 x1874601293388672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787759141.415831:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601293388672:0@lo:38: 00000100:00100000:2.0:1787759141.415899:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787759141.416025:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787759141.416128:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293388800:0@lo:400: 00000100:00100000:3.0:1787759141.416161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759141.416201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388672 00000100:00100000:3.0:1787759141.416207:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388672 00000100:00100000:3.0:1787759141.416232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388800 00000100:00100000:3.0:1787759141.416235:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388800 00000100:00100000:3.0:1787759141.416258:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759141.416266:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775afc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293388800:12345-0@lo:400: 00000100:00100000:3.0:1787759141.416316:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775afc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293388800:12345-0@lo:400: Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.416324:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759141.416338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759141.416350:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1874601293388672:12345-0@lo:38: 00010000:00080000:3.0:1787759141.416399:0:5836:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 105 last 0 00000020:00000080:3.0:1787759141.416441:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x662cc405a6abf40f 00000004:00100000:3.0:1787759141.416461:0:5836:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787759141.416496:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d7641c70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759141.416537:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874601293388672:12345-0@lo:38: Request processed in 185us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759141.416545:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787759141.416584:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d7752e403c0 x1874601293388800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759141.416598:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e403c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293388800:0@lo:400: 00010000:00080000:2.0:1787759141.416682:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d775afc5680 x1874601293388672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759141.416691:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787759141.416701:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787759141.416710:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787759141.416714:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787759141.416717:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777c9cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787759141.416724:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601293388672:0@lo:38: 00000040:00080000:3.0:1787759141.418835:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787759141.418996:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787759141.419036:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759141.419068:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759141.419092:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787759141.419148:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787759141.419150:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787759141.419152:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759141.419155:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759141.419156:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759141.419157:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759141.419159:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787759141.419161:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759141.419163:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759141.419165:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759141.419166:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787759141.419170:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787759141.419174:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787759141.419176:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787759141.419177:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787759141.419178:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787759141.419179:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787759141.419181:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787759141.419182:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787759141.419183:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787759141.419184:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787759141.419185:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787759141.419186:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787759141.419215:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787759141.419236:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388928:0@lo:253: 00000100:00100000:0.0:1787759141.419308:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759141.419352:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7745126480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759141.419359:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293388928 00000100:00100000:1.0:1787759141.419400:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293388928 00000100:00100000:1.0:1787759141.419452:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787759141.419464:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388928:12345-0@lo:253: 20000000:01000000:1.0:1787759141.419498:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787759141.419516:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787759141.436575:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787759141.436603:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787759141.436612:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787759141.436618:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787759141.436641:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436655:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787759141.436663:0:5851:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001043036s 00010000:00010000:1.0:1787759141.436667:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436672:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436687:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436692:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436696:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175c00 already unused, calling callback (ffffffffc144d530) 00010000:00010000:1.0:1787759141.436699:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436704:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436714:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436719:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759141.436724:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175c00/0x662cc405a6abf416 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759141.442349:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:6677:x1874601293388928:12345-0@lo:253: Request processed in 22880us (23033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759141.442402:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6677:1874601293388928:0@lo:253: 00000100:00100000:0.0:1787759141.442406:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 10000000:01000000:2.0:1787759141.442421:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787759141.442427:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787759141.442429:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787759141.442430:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759141.442432:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787759141.442434:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759141.442436:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759141.442437:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787759141.442439:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787759141.442454:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787759141.442456:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759141.442458:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787759141.442472:0:6677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787759141.446917:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759141.447193:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759141.447678:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759141.447900:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759141.448312:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759141.448546:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787759141.450776:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787759141.552333:0:6677:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787759141.552341:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787759141.552393:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787759141.552459:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787759141.552476:0:6677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787759141.552503:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787759142.033495:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787759142.350670:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787759142.350756:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7758776000 from 21 10000000:01000000:3.0:1787759142.350763:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759142.350818:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.350830:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.350840:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.350932:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389056:0@lo:101: 00000100:00100000:3.0:1787759142.351014:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.351083:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.351174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389056 00000100:00100000:1.0:1787759142.351257:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389056 00000100:00100000:1.0:1787759142.351342:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787759142.351355:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:5832:x1874601293389056:12345-0@lo:101: 00010000:00010000:1.0:1787759142.351411:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759142.351433:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf41d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.351490:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf41d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.351504:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf41d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.351517:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174c00, rc 0) 00000100:00100000:1.0:1787759142.351613:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389056:12345-0@lo:101: Request processed in 252us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.351622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787759142.351811:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389056:0@lo:101: 00010000:00010000:3.0:1787759142.351848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.351861:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.351957:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389184:0@lo:501: 00000100:00100000:3.0:1787759142.352010:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.352099:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.352297:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389184 00000100:00100000:1.0:1787759142.352304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389184 00000100:00100000:1.0:1787759142.352446:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787759142.352461:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389184:12345-0@lo:501: 00000100:00100000:1.0:1787759142.352974:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389184:12345-0@lo:501: Request processed in 518us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.352983:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787759142.353049:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389184:0@lo:501: 00000100:00100000:3.0:1787759142.353087:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389312:0@lo:503: 00000100:00100000:3.0:1787759142.353130:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.353200:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.353239:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389312 00000100:00100000:1.0:1787759142.353244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389312 00000100:00100000:1.0:1787759142.353327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787759142.353336:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389312:12345-0@lo:503: 00000100:00100000:1.0:1787759142.353610:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389312:12345-0@lo:503: Request processed in 274us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.353618:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787759142.353681:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389312:0@lo:503: 00000100:00100000:0.0:1787759142.355327:0:6784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6784:1874601293389440:0@lo:502: 00000100:00100000:0.0:1787759142.355454:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.355505:0:6784:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.355518:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389440 00000100:00100000:1.0:1787759142.355530:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389440 00000100:00100000:1.0:1787759142.355586:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787759142.355606:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:6784:x1874601293389440:12345-0@lo:502: 00000100:00100000:1.0:1787759142.355913:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:6784:x1874601293389440:12345-0@lo:502: Request processed in 308us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.355922:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787759142.356058:0:6784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6784:1874601293389440:0@lo:502: 00000100:00100000:0.0:1787759142.356177:0:6784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6784:1874601293389568:0@lo:502: 00000100:00100000:0.0:1787759142.356220:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.356241:0:6784:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.356279:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389568 00000100:00100000:1.0:1787759142.356285:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389568 00000100:00100000:1.0:1787759142.356319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787759142.356327:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:6784:x1874601293389568:12345-0@lo:502: 00000100:00100000:1.0:1787759142.356523:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:6784:x1874601293389568:12345-0@lo:502: Request processed in 196us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.356533:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787759142.356630:0:6784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6784:1874601293389568:0@lo:502: 00000040:00080000:0.0:1787759142.356657:0:6784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787759142.356835:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787759142.356860:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787759142.356872:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.356884:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759142.356894:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787759142.356897:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d7758776000 from 3 10000000:01000000:3.0:1787759142.356900:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787759142.356930:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.356947:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.356957:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.356972:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389696:0@lo:101: 00000100:00100000:3.0:1787759142.357008:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.357036:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.357076:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389696 00000100:00100000:1.0:1787759142.357082:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389696 00000100:00100000:1.0:1787759142.357120:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787759142.357127:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293389696:12345-0@lo:101: 00010000:00010000:1.0:1787759142.357138:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759142.357158:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf42b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.357187:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf42b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.357199:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf42b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.357210:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174000, rc 0) 00000100:00100000:1.0:1787759142.357255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293389696:12345-0@lo:101: Request processed in 128us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.357273:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787759142.357314:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389696:0@lo:101: 00010000:00010000:3.0:1787759142.357331:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.357341:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.357424:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389824:0@lo:256: 00000100:00100000:3.0:1787759142.357460:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.357487:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.357557:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389824 00000100:00100000:1.0:1787759142.357564:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389824 00000100:00100000:1.0:1787759142.357599:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787759142.357606:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293389824:12345-0@lo:256: 20000000:01000000:1.0:1787759142.357625:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787759142.357649:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787759142.357655:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1787759142.357658:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:1.0:1787759142.357932:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293389824:12345-0@lo:256: Request processed in 325us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.357941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787759142.357959:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389824:0@lo:256: 10000000:01000000:3.0:1787759142.358032:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787759142.358037:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.358046:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759142.358063:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787759142.358065:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787759142.358067:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787759142.358097:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.358104:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.358112:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.358124:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389952:0@lo:101: 00000100:00100000:3.0:1787759142.358162:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.358179:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.358216:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293389952 00000100:00100000:1.0:1787759142.358222:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293389952 00000100:00100000:1.0:1787759142.358260:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787759142.358268:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293389952:12345-0@lo:101: 00010000:00010000:1.0:1787759142.358275:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759142.358288:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf439 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.358306:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf439 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.358315:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf439 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.358323:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175400, rc 0) 00000100:00100000:1.0:1787759142.358391:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293389952:12345-0@lo:101: Request processed in 97us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.358404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787759142.358505:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293389952:0@lo:101: 00010000:00010000:3.0:1787759142.358518:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759142.358527:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759142.358731:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390080:0@lo:501: 00000100:00100000:3.0:1787759142.358821:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.358849:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.358937:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390080 00000100:00100000:1.0:1787759142.358952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390080 00000100:00100000:1.0:1787759142.359020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787759142.359028:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293390080:12345-0@lo:501: 00000100:00100000:1.0:1787759142.359333:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293390080:12345-0@lo:501: Request processed in 305us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.359343:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787759142.359426:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390080:0@lo:501: 00000100:00100000:3.0:1787759142.359458:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390208:0@lo:503: 00000100:00100000:3.0:1787759142.359508:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.359699:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.360008:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390208 00000100:00100000:0.0:1787759142.360015:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390208 00000100:00100000:0.0:1787759142.360045:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787759142.360052:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293390208:12345-0@lo:503: 00000100:00100000:0.0:1787759142.360363:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293390208:12345-0@lo:503: Request processed in 310us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.360438:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787759142.360459:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390208:0@lo:503: 00000100:00100000:3.0:1787759142.360921:0:6785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6785:1874601293390336:0@lo:502: 00000100:00100000:3.0:1787759142.360962:0:6785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.360991:0:6785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76418bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.361045:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390336 00000100:00100000:1.0:1787759142.361052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390336 00000100:00100000:1.0:1787759142.361085:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787759142.361094:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:6785:x1874601293390336:12345-0@lo:502: 00000100:00100000:1.0:1787759142.361344:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:6785:x1874601293390336:12345-0@lo:502: Request processed in 250us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.361352:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787759142.361575:0:6785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6785:1874601293390336:0@lo:502: 00000020:01000000:3.0:1787759142.361611:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787759142.361621:0:6785:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787759142.361629:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759142.361633:0:6785:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787759142.361640:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787759142.361644:0:6785:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:3.0:1787759142.361672:0:6785:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787759142.361675:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787759142.361696:0:6785:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d7641a6b490) 00000020:00000080:3.0:1787759142.361739:0:6785:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787759142.361747:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787759142.361850:0:6785:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787759142.361856:0:6785:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787759142.361864:0:6785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf44e 00010000:00080000:3.0:1787759142.361917:0:6785:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d7747b78000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:3.0:1787759142.362278:0:6785:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787759142.387940:0:6785:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787759142.387973:0:6785:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787759142.390045:0:6785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759142.392311:0:6785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759142.392500:0:6785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787759142.392623:0:6785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787759142.393022:0:6790:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787759142.393029:0:6790:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787759142.393846:0:6785:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759142.393858:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787759142.393892:0:6785:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787759142.393913:0:6785:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x662cc405a6abf455 00000100:00080000:2.0:1787759142.393925:0:6785:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787759142.393931:0:6785:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d7747b78000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1787759142.393966:0:6785:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d775aea3480 x1874601293390464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787759142.394024:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293390464:0@lo:8: 00000100:00100000:3.0:1787759142.394099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.394149:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390464 00000100:00100000:0.0:1787759142.394158:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390464 00000100:00080000:2.0:1787759142.394194:0:6785:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1787759142.394199:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787759142.394211:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775afc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874601293390464:12345-0@lo:8: 00010000:00080000:0.0:1787759142.394242:0:6679:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 106 last 0 00000020:00000080:0.0:1787759142.394269:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x662cc405a6abf45c 00000020:01000000:2.0:1787759142.394269:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759142.394275:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759142.394280:0:6785:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787759142.394283:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759142.394288:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759142.394289:0:6785:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787759142.394293:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787759142.394295:0:6785:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787759142.394321:0:6785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6785:1874601293390592:0@lo:502: 00002000:00100000:0.0:1787759142.394449:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d7641c82000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787759142.394453:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787759142.394457:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787759142.394525:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759142.394534:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293390720:0@lo:400: 00002000:00100000:0.0:1787759142.394538:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787759142.394549:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293390848:0@lo:400: 00000100:00100000:3.0:1787759142.394579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759142.394626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.394669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390720 00000100:00100000:3.0:1787759142.394675:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390720 00000100:00100000:1.0:1787759142.394696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390848 00000100:00100000:1.0:1787759142.394705:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390848 00002000:00080000:0.0:1787759142.394723:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787759142.394744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787759142.394755:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d7641c86000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759142.394760:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293390720:12345-0@lo:400: 00000100:00100000:1.0:1787759142.394784:0:5837:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787759142.394795:0:5837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1787759142.394813:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759142.394834:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775afc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874601293390464:12345-0@lo:8: Request processed in 622us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759142.394835:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293390720:12345-0@lo:400: Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.394854:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759142.394854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759142.394892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787759142.394898:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787759142.394905:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293390848:12345-0@lo:400: 00010000:00080000:0.0:1787759142.394950:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d775aea3480 x1874601293390464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787759152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759142.394960:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787759142.394965:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293390848:12345-0@lo:400: Request processed in 63us (339us total) trans 0 rc 0/0 00000100:00080000:0.0:1787759142.394972:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1787759142.394976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787759142.394982:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787759142.394990:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00010000:00080000:1.0:1787759142.394994:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775885e00 x1874601293390848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787759142.394995:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d7747b78000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787759142.395016:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787759142.395018:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293390848:0@lo:400: 00010000:00080000:3.0:1787759142.395023:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d775afc5680 x1874601293390720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759142.395026:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293390464:0@lo:8: 00000100:00100000:3.0:1787759142.395045:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293390720:0@lo:400: 00000100:00100000:2.0:1787759142.395046:0:6785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.395071:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390592 00000100:00100000:2.0:1787759142.395073:0:6785:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.395076:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390592 00000100:00100000:0.0:1787759142.395115:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787759142.395126:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:6785:x1874601293390592:12345-0@lo:502: 00000100:00100000:0.0:1787759142.397002:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:6785:x1874601293390592:12345-0@lo:502: Request processed in 1873us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.397018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:0.0:1787759142.397326:0:6790:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787759142.397874:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 106638506345ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787759142.399705:0:6785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6785:1874601293390592:0@lo:502: 00000020:01000000:2.0:1787759142.399762:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759142.399769:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759142.399772:0:6785:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787759142.399777:0:6785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787759142.399877:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787759142.399901:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787759142.399912:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.399924:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759142.399933:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787759142.399937:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7758776000 from 1 10000000:01000000:0.0:1787759142.399940:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787759142.399980:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.399987:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.399996:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759142.400017:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390976:0@lo:101: 00000100:00100000:0.0:1787759142.400084:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.400133:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410dbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.400151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293390976 00000100:00100000:0.0:1787759142.400156:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293390976 00000100:00100000:0.0:1787759142.400498:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787759142.400514:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293390976:12345-0@lo:101: 00010000:00010000:0.0:1787759142.400530:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759142.400683:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf463 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.400726:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf463 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.400737:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf463 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.400746:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7740030400, rc 0) 00000100:00100000:0.0:1787759142.400866:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293390976:12345-0@lo:101: Request processed in 358us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.400874:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787759142.401685:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af05680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293390976:0@lo:101: 00010000:00010000:1.0:1787759142.401706:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759142.401728:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759142.402554:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e42580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391104:0@lo:501: 00000100:00100000:1.0:1787759142.402598:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759142.402633:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77453793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.402689:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391104 00000100:00100000:0.0:1787759142.402694:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391104 00000100:00100000:0.0:1787759142.402770:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787759142.402779:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293391104:12345-0@lo:501: 00000100:00100000:0.0:1787759142.403032:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293391104:12345-0@lo:501: Request processed in 254us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.403039:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787759142.403122:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e42580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391104:0@lo:501: 00000100:00100000:0.0:1787759142.403157:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391232:0@lo:503: 00000100:00100000:0.0:1787759142.403198:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.403854:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410dbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759142.403865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391232 00000100:00100000:2.0:1787759142.403871:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391232 00000100:00100000:2.0:1787759142.403919:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787759142.403926:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293391232:12345-0@lo:503: 00000100:00100000:2.0:1787759142.404287:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293391232:12345-0@lo:503: Request processed in 360us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759142.404295:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787759142.404431:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391232:0@lo:503: 00000100:00100000:2.0:1787759142.404632:0:6795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6795:1874601293391360:0@lo:502: 00000100:00100000:2.0:1787759142.404671:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759142.404691:0:6795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.405281:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391360 00000100:00100000:0.0:1787759142.405287:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391360 00000100:00100000:0.0:1787759142.405321:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787759142.405331:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:6795:x1874601293391360:12345-0@lo:502: 00000100:00100000:0.0:1787759142.405706:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:6795:x1874601293391360:12345-0@lo:502: Request processed in 376us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.405731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787759142.405850:0:6795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6795:1874601293391360:0@lo:502: 00000020:01000000:0.0:1787759142.405877:0:6795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759142.405887:0:6795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759142.405889:0:6795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787759142.405895:0:6795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7758776000 00000020:00000080:0.0:1787759142.405897:0:6795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787759142.405922:0:6795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6795:1874601293391488:0@lo:502: 00000100:00100000:0.0:1787759142.405961:0:6795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.405997:0:6795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410db300 going to sleep for 11 seconds 00000100:00100000:2.0:1787759142.406423:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391488 00000100:00100000:2.0:1787759142.406428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391488 00000100:00100000:2.0:1787759142.406452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787759142.406464:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:6795:x1874601293391488:12345-0@lo:502: 00000100:00100000:2.0:1787759142.406578:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:6795:x1874601293391488:12345-0@lo:502: Request processed in 114us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759142.406586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787759142.406748:0:6795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:6795:1874601293391488:0@lo:502: 00000020:01000000:0.0:1787759142.406773:0:6795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759142.406778:0:6795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759142.406780:0:6795:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787759142.406784:0:6795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787759142.406839:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787759142.406863:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787759142.406872:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.406882:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759142.406893:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787759142.406895:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7746458000 from 1 10000000:01000000:0.0:1787759142.406898:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759142.406932:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.406945:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.406954:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759142.406967:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391616:0@lo:101: 00000100:00100000:0.0:1787759142.407001:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.407042:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410db300 going to sleep for 11 seconds 00000100:00100000:0.0:1787759142.407056:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391616 00000100:00100000:0.0:1787759142.407060:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391616 00000100:00100000:0.0:1787759142.407097:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787759142.407106:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293391616:12345-0@lo:101: 00010000:00010000:0.0:1787759142.407115:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759142.407128:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf471 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.407155:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf471 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.407166:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf471 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.407176:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7740030a00, rc 0) 00000100:00100000:0.0:1787759142.407214:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293391616:12345-0@lo:101: Request processed in 110us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.407221:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787759142.407270:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391616:0@lo:101: 00010000:00010000:0.0:1787759142.407282:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.407292:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759142.407335:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391744:0@lo:501: 00000100:00100000:0.0:1787759142.407363:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759142.407403:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d76410db300 going to sleep for 11 seconds 00000100:00100000:2.0:1787759142.407414:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391744 00000100:00100000:2.0:1787759142.407420:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391744 00000100:00100000:2.0:1787759142.407449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787759142.407458:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293391744:12345-0@lo:501: 00000100:00100000:2.0:1787759142.407594:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293391744:12345-0@lo:501: Request processed in 137us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759142.407602:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787759142.407611:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293391744:0@lo:501: 10000000:01000000:0.0:1787759142.407629:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787759142.407632:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759142.407637:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787759142.414730:0:6791:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787759142.414752:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293391872:0@lo:13: 00000100:00100000:3.0:1787759142.414764:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392000:0@lo:7: 00000100:00100000:3.0:1787759142.414845:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759142.414857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759142.414885:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392000 00000100:00100000:2.0:1787759142.414894:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392000 00000100:00100000:3.0:1787759142.414917:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774859e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759142.414964:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759142.414975:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775884780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874601293392000:12345-0@lo:7: 00000100:00100000:1.0:1787759142.414981:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293391872 00000100:00100000:1.0:1787759142.414990:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293391872 00000100:00100000:1.0:1787759142.415049:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759142.415060:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874601293391872:12345-0@lo:13: 00002000:00000024:1.0:1787759142.415085:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1787759142.415135:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e42580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874601293391872:12345-0@lo:13: Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759142.415144:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787759142.415179:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787759142.415244:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775887480 x1874601293391872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759142.415275:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293391872:0@lo:13: 00002000:00080000:2.0:1787759142.418930:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787759142.418938:0:6682:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787759142.419028:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775884780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874601293392000:12345-0@lo:7: Request processed in 4051us (4179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759142.419039:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787759142.419066:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d77758843c0 x1874601293392000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787759158 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759142.419082:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392000:0@lo:7: 00000004:00080000:3.0:1787759142.419101:0:6791:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787759142.419145:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392128:0@lo:5: 00000100:00100000:3.0:1787759142.419205:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.419286:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392128 00000100:00100000:3.0:1787759142.419302:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392128 00000100:00100000:3.0:1787759142.419347:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759142.419354:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775887c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6791:x1874601293392128:12345-0@lo:5: 00002000:00080000:3.0:1787759142.419410:0:6681:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787759142.419415:0:6681:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787759142.419724:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775887c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6791:x1874601293392128:12345-0@lo:5: Request processed in 356us (506us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787759142.419730:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759142.419774:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774859e180 going to sleep for 11 seconds 00010000:00080000:3.0:1787759142.419790:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d77758843c0 x1874601293392128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759158 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759142.419802:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392128:0@lo:5: 00000004:00080000:3.0:1787759142.419810:0:6791:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787759142.419835:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392256:0@lo:700: 00000100:00100000:3.0:1787759142.419862:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.419883:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774859e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787759142.419903:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392256 00000100:00100000:3.0:1787759142.419907:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392256 00000100:00100000:3.0:1787759142.419967:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787759142.419976:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6791:x1874601293392256:12345-0@lo:700: 00000100:00100000:3.0:1787759142.420007:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874601293392384:0@lo:700: 00000100:00100000:3.0:1787759142.420053:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759142.420080:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774859ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787759142.420211:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392384 00000100:00100000:1.0:1787759142.420215:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392384 00000100:00100000:1.0:1787759142.420252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759142.420259:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874601293392384:12345-0@lo:700: 00000004:00080000:2.0:1787759142.434721:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787759142.448877:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787759142.452248:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1874601293392384:12345-0@lo:700: Request processed in 31982us (32187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759142.452268:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787759142.452758:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775886940 x1874601293392384/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787759158 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759142.452775:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1874601293392384:0@lo:700: 40000000:02000000:2.0:1787759142.452789:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1787759142.493040:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787759142.493075:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1787759142.493165:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6791:x1874601293392256:12345-0@lo:700: Request processed in 73174us (73286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759142.493190:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787759142.493201:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775884f00 x1874601293392256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787759158 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759142.493224:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392256:0@lo:700: 00000004:02000040:2.0:1787759142.523152:0:6791:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787759142.529802:0:6791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392512:0@lo:5: 00000100:00100000:3.0:1787759142.529908:0:6791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759142.529985:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392512 00000100:00100000:3.0:1787759142.529998:0:6791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747d72180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759142.530018:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392512 00000100:00100000:2.0:1787759142.530096:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787759142.530110:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775886580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6791:x1874601293392512:12345-0@lo:5: 00002000:00080000:2.0:1787759142.536944:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787759142.536969:0:6682:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787759142.540619:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775886580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6791:x1874601293392512:12345-0@lo:5: Request processed in 10507us (10705us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787759142.540632:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787759142.540690:0:6791:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775884f00 x1874601293392512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759158 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759142.540704:0:6791:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787759142.540738:0:6791:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7775884f00 x1874601293392512/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759158 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759142.540751:0:6791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6791:1874601293392512:0@lo:5: 00000004:00080000:2.0:1787759142.540767:0:6791:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787759143.055505:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759144.079568:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759144.604751:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787759145.103501:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759146.126763:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759147.154542:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787759147.841190:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1787759147.856762:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293392768:0@lo:13: 00000100:00100000:3.0:1787759147.856789:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293392640:0@lo:400: 00000100:00100000:3.0:1787759147.856835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759147.856839:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293393024:0@lo:400: 00000100:00100000:2.0:1787759147.856840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759147.856890:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293393152:0@lo:400: 00000100:00100000:2.0:1787759147.856912:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392768 00000100:00100000:2.0:1787759147.856919:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392768 00000100:00100000:1.0:1787759147.856924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759147.856929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759147.856967:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293392896:0@lo:400: 00000100:00100000:2.0:1787759147.856988:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759147.856993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759147.856994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393024 00000100:00100000:2.0:1787759147.857000:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293392768:12345-0@lo:13: 00000100:00100000:1.0:1787759147.857001:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393024 00000100:00100000:0.0:1787759147.857011:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392640 00000100:00100000:0.0:1787759147.857017:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392640 00000100:00100000:3.0:1787759147.857032:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393152 00002000:00000024:2.0:1787759147.857036:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759147.857037:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393152 00000100:00100000:1.0:1787759147.857040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293392896 00000100:00100000:1.0:1787759147.857045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293392896 00000100:00100000:0.0:1787759147.857055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787759147.857066:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3303:x1874601293392640:12345-0@lo:400: 00000100:00100000:3.0:1787759147.857075:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759147.857078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787759147.857089:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775884b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601293393152:12345-0@lo:400: 00000100:00100000:1.0:1787759147.857091:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293393024:12345-0@lo:400: 00000100:00100000:0.0:1787759147.857117:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3303:x1874601293392640:12345-0@lo:400: Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759147.857134:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787759147.857153:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874601293392768:12345-0@lo:13: Request processed in 154us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759147.857154:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775884b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601293393152:12345-0@lo:400: Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759147.857162:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293393024:12345-0@lo:400: Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759147.857166:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759147.857176:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787759147.857182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787759147.857191:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293392640:0@lo:400: 00000100:00080000:2.0:1787759147.857195:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759147.857201:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787759147.857203:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787759147.857212:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775886d00 x1874601293393152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759147.857212:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293392896:12345-0@lo:400: 00000100:00100000:0.0:1787759147.857228:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:2.0:1787759147.857229:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d775aea3480 x1874601293392768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787759147.857241:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d77758861c0 x1874601293393024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759147.857247:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293393152:0@lo:400: 00000100:00100000:2.0:1787759147.857256:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293392768:0@lo:13: 00000100:00100000:3.0:1787759147.857257:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293392896:12345-0@lo:400: Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759147.857260:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293393024:0@lo:400: 00000100:00100000:3.0:1787759147.857266:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787759147.857311:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775885680 x1874601293392896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759147.857321:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293392896:0@lo:400: 00010000:00010000:1.0:1787759148.177936:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759149.198568:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759150.222643:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759151.246568:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787759151.528225:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787759151.528229:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787759151.528326:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d7641cc9000 00000020:01000004:1.0:1787759151.528343:0:7614:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787759151.528354:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787759151.528654:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d7748204ed8) 00000020:00000080:1.0:1787759151.528672:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787759151.541134:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787759151.541433:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787759151.556711:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787759151.560976:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787759151.561010:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787759151.561067:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787759151.561096:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787759151.561487:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787759151.561498:0:7614:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787759151.561508:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x662cc405a6abf486 00000020:01000004:1.0:1787759151.561516:0:7614:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787759151.561548:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.138@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787759151.561551:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787759151.561557:0:7614:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787759151.561578:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787759151.561582:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787759151.578173:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.138@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787759151.578210:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.138@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787759151.578214:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787759151.578216:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787759151.578217:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759151.578218:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759151.578220:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759151.578221:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759151.578223:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759151.578225:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759151.578226:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759151.578228:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759151.578229:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759151.578234:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787759151.578236:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787759151.578238:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787759151.578239:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787759151.578240:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787759151.578241:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787759151.578247:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787759151.578248:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787759151.578249:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787759151.578250:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787759151.578251:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787759151.578252:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787759151.578277:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787759151.578295:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293393280:0@lo:253: 00000100:00100000:1.0:1787759151.578437:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.578505:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393280 00000100:00100000:2.0:1787759151.578513:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393280 00000100:00100000:1.0:1787759151.578541:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.578609:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787759151.578620:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:7614:x1874601293393280:12345-0@lo:253: 20000000:01000000:2.0:1787759151.578649:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787759151.578652:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787759151.578657:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787759151.578660:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1787759151.580341:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787759151.580525:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787759151.580549:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1787759151.580582:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787759151.580590:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1787759151.580616:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787759151.580660:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1787759151.581246:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787759151.581265:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:2.0:1787759151.581267:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:2.0:1787759151.581297:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787759151.581305:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787759151.581345:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787759151.581354:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:2.0:1787759151.581416:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787759151.581434:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787759151.581464:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787759151.581509:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787759151.582475:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1787759151.582503:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.138@tcp 20000000:01000000:2.0:1787759151.582505:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.138@tcp (null) (null) (null) 00000040:00080000:2.0:1787759151.582551:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1787759151.582560:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787759151.582589:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1787759151.582596:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.138@tcp (null) (null) 00000040:00080000:2.0:1787759151.582770:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1787759151.582781:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787759151.583558:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1787759151.583606:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1787759151.583626:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787759151.583629:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787759151.583634:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787759151.583636:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787759151.583701:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787759151.583714:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787759151.583717:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787759151.583860:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787759151.583863:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787759151.584621:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787759151.584663:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787759151.584714:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787759151.584936:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787759151.584977:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787759151.585013:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787759151.585026:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787759151.585027:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787759151.586076:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787759151.586151:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787759151.586194:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787759151.586496:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787759151.586550:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787759151.586642:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787759151.586657:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787759151.586659:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787759151.587686:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787759151.587727:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787759151.587772:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787759151.587947:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787759151.587987:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787759151.588041:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787759151.588056:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787759151.588058:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787759151.588766:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787759151.588906:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787759151.588944:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787759151.589005:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1787759151.589022:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787759151.589040:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589058:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589065:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589072:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589078:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589098:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf471 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589105:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589142:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589155:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 16 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589170:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e41a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393408:0@lo:104: 00000100:00100000:1.0:1787759151.589232:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759151.589290:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589298:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589307:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e41680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393536:0@lo:104: 00000100:00100000:1.0:1787759151.589334:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759151.589363:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.589394:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787759151.589405:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393408 00000100:00100000:3.0:1787759151.589410:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393408 00000100:00100000:3.0:1787759151.589439:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393536 00000100:00100000:3.0:1787759151.589441:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393536 00000100:00100000:3.0:1787759151.589455:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759151.589462:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293393408:12345-0@lo:104: 00010000:00010000:3.0:1787759151.589477:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589521:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759151.589526:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293393408:12345-0@lo:104: Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.589547:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759151.589563:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759151.589574:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7760009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293393536:12345-0@lo:104: 00010000:00010000:3.0:1787759151.589581:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589613:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787759151.589618:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7760009c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293393536:12345-0@lo:104: Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.589624:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787759151.589645:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589656:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e430c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393664:0@lo:104: 00010000:00010000:3.0:1787759151.589663:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787759151.589670:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589678:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740031a00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759151.589683:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589692:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759151.589695:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759151.589702:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759151.589706:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787759151.589720:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589729:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589731:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589743:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759151.589749:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e42d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393792:0@lo:104: 00010000:00010000:3.0:1787759151.589758:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589772:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf478 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589773:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759151.589787:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759151.589792:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589797:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166f200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759151.589800:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589807:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589809:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759151.589819:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.589826:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759151.589827:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787759151.589840:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293394048:0@lo:104: 00010000:00010000:3.0:1787759151.589844:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589852:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759151.589866:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759151.589874:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.589880:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608780 going to sleep for 11 seconds 00010000:00010000:3.0:1787759151.589883:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf440 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.589895:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759151.589900:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e41a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393408:0@lo:104: 00010000:00010000:3.0:1787759151.589903:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759151.589907:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759151.589912:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e41680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393536:0@lo:104: 00010000:00010000:3.0:1787759151.589914:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759151.589930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293393920:0@lo:103: 00000100:00100000:3.0:1787759151.589956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.590003:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293394176:0@lo:103: 00000100:00100000:3.0:1787759151.590019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759151.590026:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393664 00000100:00100000:0.0:1787759151.590032:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393664 00000100:00100000:3.0:1787759151.590045:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393920 00000100:00100000:3.0:1787759151.590049:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393920 00000100:00100000:0.0:1787759151.590057:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293393792 00000100:00100000:0.0:1787759151.590063:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293393792 00010000:00010000:3.0:1787759151.590064:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 17 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590080:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394048 00000100:00100000:3.0:1787759151.590084:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394176 00000100:00100000:0.0:1787759151.590085:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394048 00000100:00100000:3.0:1787759151.590089:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394176 00000100:00100000:0.0:1787759151.590103:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787759151.590106:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 18 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590115:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e42940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5830:x1874601293393664:12345-0@lo:104: 00010000:00010000:0.0:1787759151.590124:0:6314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.590130:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759151.590146:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77485d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3304:x1874601293393920:12345-0@lo:103: 00010000:00010000:3.0:1787759151.590157:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759151.590162:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 18 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.590172:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787759151.590173:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787759151.590175:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 18 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590187:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e42940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5830:x1874601293393664:12345-0@lo:104: Request processed in 72us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.590187:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:5830:x1874601293393792:12345-0@lo:104: 00010000:00010000:3.0:1787759151.590196:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7740030a00/0x662cc405a6abf478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf471 expref: 18 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590197:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590202:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787759151.590223:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1787759151.590224:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759151.590234:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293394048:12345-0@lo:104: 00010000:00010000:0.0:1787759151.590251:0:6314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590253:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787759151.590263:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:5830:x1874601293393792:12345-0@lo:104: Request processed in 81us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.590272:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77485d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:3304:x1874601293393920:12345-0@lo:103: Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.590273:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787759151.590284:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787759151.590293:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787759151.590301:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5830:x1874601293394048:12345-0@lo:104: Request processed in 70us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.590314:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759151.590328:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787759151.590339:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775885e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3305:x1874601293394176:12345-0@lo:103: 00010000:00010000:3.0:1787759151.590345:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787759151.590349:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759151.590351:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590358:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590364:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e200 already unused, calling callback (ffffffffc1a48c20) 00010000:00010000:2.0:1787759151.590391:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759151.590392:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590409:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175400/0x662cc405a6abf440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf439 expref: 16 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.590425:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e430c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393664:0@lo:104: 10000000:00010000:3.0:1787759151.590427:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590434:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:3.0:1787759151.590438:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787759151.590441:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e42d00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293393792:0@lo:104: 00000100:00100000:1.0:1787759151.590455:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1874601293394048:0@lo:104: 00010000:00010000:3.0:1787759151.590464:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590472:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759151.590477:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775885e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3305:x1874601293394176:12345-0@lo:103: Request processed in 139us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.590485:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787759151.590486:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.590487:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590504:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf424 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590518:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787759151.590522:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590551:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a81400 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759151.590556:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.590560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293393920:0@lo:103: 00010000:00010000:3.0:1787759151.590568:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759151.590577:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.590579:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1787759151.590586:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759151.590607:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590613:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787759151.590623:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293394176:0@lo:103: 00010000:00010000:3.0:1787759151.590628:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.590635:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787759151.590637:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a81400/0x662cc405a6abf3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3fa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.590643:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293394304:0@lo:103: 00010000:00010000:3.0:1787759151.590653:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759151.590656:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759151.590659:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759151.590674:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775887840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293394432:0@lo:103: 00000100:00100000:2.0:1787759151.590682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.590715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759151.590744:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394304 00000100:00100000:0.0:1787759151.590749:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394304 00000100:00100000:3.0:1787759151.590759:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394432 00000100:00100000:3.0:1787759151.590764:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394432 00010000:00010000:0.0:1787759151.590768:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 15 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590781:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590798:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787759151.590860:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3305:x1874601293394304:12345-0@lo:103: 00010000:00010000:0.0:1787759151.590869:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759151.590873:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.590883:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.590894:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf41d expref: 16 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.590902:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787759151.590908:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759151.590913:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3303:x1874601293394432:12345-0@lo:103: 00010000:00010000:3.0:1787759151.590923:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759151.590927:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 15 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590937:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 15 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.590949:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf3fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf3f3 expref: 15 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759151.590955:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3305:x1874601293394304:12345-0@lo:103: Request processed in 147us (274us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759151.590962:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759151.590966:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759151.591001:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3303:x1874601293394432:12345-0@lo:103: Request processed in 90us (287us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759151.591008:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759151.591009:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787759151.591017:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759151.591019:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759151.591053:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775887840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293394432:0@lo:103: 00010000:00010000:2.0:1787759151.591071:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591075:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e800 already unused, calling callback (ffffffffc1a48c20) 00000100:00100000:1.0:1787759151.591078:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293394304:0@lo:103: 10000000:00010000:2.0:1787759151.591080:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591089:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759151.591101:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759151.591106:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787759151.591132:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591139:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759151.591165:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591173:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166e800/0x662cc405a6abf3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3d0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.591183:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293394560:0@lo:103: 00010000:00010000:2.0:1787759151.591191:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759151.591193:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759151.591195:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759151.591207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.591242:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394560 00000100:00100000:2.0:1787759151.591246:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394560 00010000:00010000:2.0:1787759151.591260:0:5866:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 13 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.591277:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759151.591282:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775886d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3304:x1874601293394560:12345-0@lo:103: 00010000:00010000:2.0:1787759151.591288:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759151.591291:0:5866:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 13 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591298:0:5866:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 13 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591305:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf3d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf3c9 expref: 13 pid: 5830 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591312:0:5866:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591318:0:5866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591325:0:5866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591329:0:5866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591337:0:5866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591342:0:5866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591345:0:5866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175000 already unused, calling callback (ffffffffc144d530) 00010000:00010000:2.0:1787759151.591347:0:5866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591352:0:5866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591361:0:5866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.591407:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759151.591435:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775886d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3304:x1874601293394560:12345-0@lo:103: Request processed in 152us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.591441:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759151.591445:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293394560:0@lo:103: 00010000:00010000:1.0:1787759151.591501:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.591511:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.591517:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf48d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787759151.591528:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787759151.618962:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:7614:x1874601293393280:12345-0@lo:253: Request processed in 40334us (40515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759151.618977:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787759151.619151:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293393280:0@lo:253: 10000000:01000000:2.0:1787759151.619170:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787759151.619174:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787759151.619176:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787759151.619177:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787759151.619179:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787759151.619180:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787759151.619181:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787759151.619183:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787759151.619185:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787759151.619187:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787759151.619202:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787759151.619226:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d7641cc9000 from lustre-OST0001 10000000:01000000:2.0:1787759151.619252:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787759151.619256:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787759151.619264:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d7746458000 local copy 10000000:01000000:2.0:1787759151.619268:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787759151.619304:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.619316:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.619325:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.619344:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394688:0@lo:101: 00000100:00100000:2.0:1787759151.619471:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.619569:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759151.619644:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394688 00000100:00100000:3.0:1787759151.619650:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394688 00000100:00100000:3.0:1787759151.619722:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787759151.619731:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+11:7614:x1874601293394688:12345-0@lo:101: 00010000:00010000:3.0:1787759151.619742:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759151.619755:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf494 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.619786:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf494 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.619796:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf494 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.619805:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166ee00, rc 0) 00000100:00100000:3.0:1787759151.619844:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293394688:12345-0@lo:101: Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.619850:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787759151.619902:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394688:0@lo:101: 00010000:00010000:2.0:1787759151.619913:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.619923:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.620012:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394816:0@lo:501: 00000100:00100000:2.0:1787759151.620038:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.620204:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.620273:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394816 00000100:00100000:0.0:1787759151.620277:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394816 00000100:00100000:0.0:1787759151.620299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787759151.620306:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293394816:12345-0@lo:501: 00000100:00100000:0.0:1787759151.620527:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293394816:12345-0@lo:501: Request processed in 220us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787759151.620544:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787759151.620625:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394816:0@lo:501: 10000000:01000000:2.0:1787759151.620643:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787759151.620675:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787759151.620681:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620689:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620696:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620719:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787759151.620736:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d7641cc9000 10000000:01000000:2.0:1787759151.620742:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787759151.620747:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787759151.620750:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787759151.620753:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787759151.620756:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787759151.620771:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620779:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620786:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.620797:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394944:0@lo:101: 00000100:00100000:2.0:1787759151.620822:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.620838:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.620850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293394944 00000100:00100000:2.0:1787759151.620858:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293394944 00000100:00100000:2.0:1787759151.620879:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787759151.620885:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293394944:12345-0@lo:101: 00010000:00010000:2.0:1787759151.620891:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759151.620900:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf4a2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620918:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620926:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.620933:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80400, rc 0) 00000100:00100000:2.0:1787759151.620959:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293394944:12345-0@lo:101: Request processed in 75us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.620965:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787759151.620993:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293394944:0@lo:101: 00010000:00010000:2.0:1787759151.621002:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.621009:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759151.621057:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395072:0@lo:501: 00000100:00100000:2.0:1787759151.621099:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.621122:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759151.621123:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395072 00000100:00100000:3.0:1787759151.621129:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395072 00000100:00100000:3.0:1787759151.621163:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787759151.621170:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395072:12345-0@lo:501: 00010000:00010000:0.0:1787759151.621250:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759151.621257:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.621266:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a81000 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759151.621270:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.621278:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759151.621285:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759151.621292:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787759151.621313:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.621320:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787759151.621339:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395072:12345-0@lo:501: Request processed in 168us (238us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759151.621343:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.621351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787759151.621391:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a81000/0x662cc405a6abf494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x662cc405a6abf49b expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.621404:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759151.621406:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759151.621408:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759151.621417:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759151.621428:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293395200:0@lo:103: 00000100:00100000:0.0:1787759151.621455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.621544:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395072:0@lo:501: 00000100:00100000:2.0:1787759151.621580:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395328:0@lo:503: 00000100:00100000:2.0:1787759151.621615:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.621635:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.621671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395328 00000100:00100000:0.0:1787759151.621674:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395328 00000100:00100000:0.0:1787759151.621704:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787759151.621711:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395328:12345-0@lo:503: 00000100:00100000:0.0:1787759151.621841:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395328:12345-0@lo:503: Request processed in 130us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.621847:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787759151.621909:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395328:0@lo:503: 00000040:00080000:2.0:1787759151.622259:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787759151.622313:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395456:0@lo:502: 00000100:00100000:2.0:1787759151.622347:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.622392:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.622446:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395456 00000100:00100000:0.0:1787759151.622450:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395456 00000100:00100000:0.0:1787759151.622481:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787759151.622488:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395456:12345-0@lo:502: 00000100:00100000:0.0:1787759151.622616:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395456:12345-0@lo:502: Request processed in 129us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.622623:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787759151.622684:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395456:0@lo:502: 00000100:00100000:3.0:1787759151.622797:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395200 00000100:00100000:3.0:1787759151.622802:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395200 00000100:00100000:3.0:1787759151.622847:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787759151.622857:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3306:x1874601293395200:12345-0@lo:103: 00010000:00010000:3.0:1787759151.622867:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759151.622881:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf494 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.622896:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759151.622931:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af06940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3306:x1874601293395200:12345-0@lo:103: Request processed in 77us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.622945:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:2.0:1787759151.622959:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787759151.623007:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787759151.623044:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787759151.623154:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787759151.623190:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787759151.623220:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787759151.623239:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395584:0@lo:502: 00000100:00100000:2.0:1787759151.623269:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.623289:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.623348:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293395200:0@lo:103: 00000100:00100000:0.0:1787759151.623390:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395584 00000100:00100000:0.0:1787759151.623394:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395584 00000100:00100000:0.0:1787759151.623423:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787759151.623428:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293395584:12345-0@lo:502: 00000100:00100000:0.0:1787759151.623547:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293395584:12345-0@lo:502: Request processed in 118us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.623554:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787759151.623659:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395584:0@lo:502: 00000040:00080000:3.0:1787759151.623734:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787759151.623743:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787759151.624551:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787759151.624561:0:7622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787759151.624568:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759151.624570:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787759151.624575:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787759151.624590:0:7622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d7641a6ced8) 00000020:00000080:3.0:1787759151.624613:0:7622:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787759151.624619:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787759151.624680:0:7622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7641cc9000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787759151.624689:0:7622:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787759151.624700:0:7622:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x662cc405a6abf4b7 00010000:00010000:3.0:1787759151.628217:0:7622:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787759151.628743:0:7622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787759151.631595:0:7622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787759151.631898:0:7622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787759151.636061:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787759151.637474:0:7622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787759151.639970:0:7622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787759151.639988:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759151.639995:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759151.639998:0:7622:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787759151.640001:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759151.640006:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759151.640007:0:7622:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759151.640010:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759151.640012:0:7622:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787759151.642172:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759151.642184:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759151.642186:0:7622:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787759151.642192:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787759151.642606:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787759151.642632:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787759151.642655:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.642667:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759151.642676:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7641cc9000 from 1 10000000:01000000:3.0:1787759151.642679:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759151.642716:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.642725:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.642736:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.642763:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395712:0@lo:101: 00000100:00100000:3.0:1787759151.642835:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.642874:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776099b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.644435:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395712 00000100:00100000:0.0:1787759151.644446:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395712 00000100:00100000:0.0:1787759151.644504:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787759151.644517:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:7614:x1874601293395712:12345-0@lo:101: 00010000:00010000:0.0:1787759151.644551:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759151.644771:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf4be expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.644800:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf4be expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.644811:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4be expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759151.644820:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7740031400, rc 0) 00000100:00100000:0.0:1787759151.644878:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395712:12345-0@lo:101: Request processed in 363us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.644884:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787759151.645043:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395712:0@lo:101: 00010000:00010000:3.0:1787759151.645059:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.645136:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.645256:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395840:0@lo:501: 00000100:00100000:3.0:1787759151.645294:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.645321:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776099b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.645514:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395840 00000100:00100000:0.0:1787759151.645518:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395840 00000100:00100000:0.0:1787759151.645562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787759151.645570:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395840:12345-0@lo:501: 00000100:00100000:0.0:1787759151.645832:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395840:12345-0@lo:501: Request processed in 261us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.645845:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787759151.645977:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395840:0@lo:501: 00000100:00100000:3.0:1787759151.646006:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395968:0@lo:503: 00000100:00100000:3.0:1787759151.646044:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.646261:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776099b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.646300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293395968 00000100:00100000:2.0:1787759151.646305:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293395968 00000100:00100000:2.0:1787759151.646329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787759151.646336:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395968:12345-0@lo:503: 00000100:00100000:2.0:1787759151.646707:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293395968:12345-0@lo:503: Request processed in 371us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.646715:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787759151.646866:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293395968:0@lo:503: 00000040:00080000:3.0:1787759151.647229:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787759151.647288:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396096:0@lo:502: 00000100:00100000:3.0:1787759151.647326:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.647356:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77600b5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.647821:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396096 00000100:00100000:0.0:1787759151.647826:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396096 00000100:00100000:0.0:1787759151.647864:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787759151.647872:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293396096:12345-0@lo:502: 00000100:00100000:0.0:1787759151.648044:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293396096:12345-0@lo:502: Request processed in 172us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.648052:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787759151.648159:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396096:0@lo:502: 00000040:00080000:3.0:1787759151.648622:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787759151.648672:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787759151.648698:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396224:0@lo:502: 00000100:00100000:3.0:1787759151.648735:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.649168:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776099b840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759151.649748:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396224 00000100:00100000:0.0:1787759151.649755:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396224 00000100:00100000:0.0:1787759151.649820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787759151.649829:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293396224:12345-0@lo:502: 00000100:00100000:0.0:1787759151.650018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293396224:12345-0@lo:502: Request processed in 190us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759151.650026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787759151.650156:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396224:0@lo:502: 00000040:00080000:3.0:1787759151.650254:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787759151.650265:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787759151.650817:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759151.650831:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759151.650834:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787759151.650840:0:7626:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7641cc9000 00000020:00000080:2.0:1787759151.650843:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787759151.650872:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759151.650876:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759151.650878:0:7626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787759151.650881:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787759151.651004:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787759151.651021:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759151.651132:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.651149:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759151.651188:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787759151.651191:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d7641cc9000 10000000:01000000:3.0:1787759151.651194:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d7641cc9000 10000000:01000000:3.0:1787759151.651199:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787759151.651204:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7641cc9000 from 1 10000000:01000000:3.0:1787759151.651207:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759151.651234:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.651243:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.651252:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.651268:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396352:0@lo:101: 00000100:00100000:3.0:1787759151.651307:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.651342:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.651411:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396352 00000100:00100000:2.0:1787759151.651417:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396352 00000100:00100000:2.0:1787759151.651451:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787759151.651460:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293396352:12345-0@lo:101: 00010000:00010000:2.0:1787759151.651470:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759151.651482:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf4cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.651503:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.651514:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.651522:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81600, rc 0) 00000100:00100000:2.0:1787759151.651569:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396352:12345-0@lo:101: Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.651575:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787759151.651648:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396352:0@lo:101: 00010000:00010000:1.0:1787759151.651661:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.651670:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.651736:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396480:0@lo:501: 00000100:00100000:1.0:1787759151.651758:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759151.651781:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608840 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.651818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396480 00000100:00100000:2.0:1787759151.651822:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396480 00000100:00100000:2.0:1787759151.651843:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787759151.651849:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396480:12345-0@lo:501: 00000100:00100000:2.0:1787759151.652040:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396480:12345-0@lo:501: Request processed in 190us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.652047:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787759151.652258:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396480:0@lo:501: 00000100:00100000:1.0:1787759151.652287:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396608:0@lo:503: 00000100:00100000:1.0:1787759151.652324:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759151.652352:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608840 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.652432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396608 00000100:00100000:2.0:1787759151.652437:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396608 00000100:00100000:2.0:1787759151.652463:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787759151.652470:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396608:12345-0@lo:503: 00000100:00100000:2.0:1787759151.652610:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396608:12345-0@lo:503: Request processed in 140us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.652616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787759151.652714:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396608:0@lo:503: 00000040:00080000:1.0:1787759151.652936:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787759151.652984:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396736:0@lo:502: 00000100:00100000:1.0:1787759151.653016:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759151.653084:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608840 going to sleep for 11 seconds 00000100:00100000:3.0:1787759151.653258:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396736 00000100:00100000:3.0:1787759151.653263:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396736 00000100:00100000:3.0:1787759151.653323:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787759151.653330:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396736:12345-0@lo:502: 00000100:00100000:3.0:1787759151.653573:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396736:12345-0@lo:502: Request processed in 243us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.653580:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787759151.653692:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396736:0@lo:502: 00000040:00080000:1.0:1787759151.653949:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787759151.653994:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787759151.654029:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787759151.654141:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787759151.654179:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787759151.654228:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787759151.654265:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787759151.654300:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787759151.654350:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787759151.654412:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787759151.654449:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787759151.654499:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787759151.654551:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787759151.654588:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787759151.654636:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787759151.654675:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787759151.654711:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787759151.654761:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787759151.654799:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787759151.654834:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787759151.654881:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787759151.654934:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787759151.654971:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787759151.655019:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787759151.655054:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787759151.655172:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787759151.655230:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787759151.655264:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787759151.655292:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787759151.655344:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787759151.655401:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787759151.655434:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787759151.655464:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787759151.655503:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787759151.655547:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787759151.655589:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787759151.655621:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787759151.655658:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396864:0@lo:502: 00000100:00100000:1.0:1787759151.655718:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759151.655916:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608840 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.655993:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396864 00000100:00100000:2.0:1787759151.656000:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396864 00000100:00100000:2.0:1787759151.656035:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787759151.656044:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396864:12345-0@lo:502: 00000100:00100000:2.0:1787759151.656319:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293396864:12345-0@lo:502: Request processed in 276us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.656327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787759151.656460:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293396864:0@lo:502: 00000040:00080000:1.0:1787759151.656546:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787759151.656556:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787759151.657408:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787759151.657422:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d7748201a48) 00000020:00000080:1.0:1787759151.657442:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787759151.657514:0:7627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d7641cc9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787759151.657518:0:7627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7641cc9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787759151.657521:0:7627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7641cc9000 3 00010000:00080000:1.0:1787759151.657562:0:7627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d777c8a6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.138@tcp at head 00010000:00010000:1.0:1787759151.659653:0:7627:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787759151.659883:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787759151.659917:0:7627:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787759151.659928:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x662cc405a6abf4e1 00000100:00080000:1.0:1787759151.659938:0:7627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787759151.659950:0:7627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d777c8a6000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:1.0:1787759151.659983:0:7627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d776dc4ed00 x1874601293396992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787759151.660010:0:7627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1787759151.660280:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1787759151.660431:0:7628:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d776dc4f840 x1874601293397120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759151.660440:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1787759151.660579:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293397504:0@lo:400: 00000100:00100000:3.0:1787759151.660642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.660677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759151.660683:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293397376:0@lo:400: 00000100:00100000:3.0:1787759151.660709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787759151.660733:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787759151.660756:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787759151.660768:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.660779:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787759151.660824:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787759151.660826:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759151.660827:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759151.660829:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759151.660830:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759151.660832:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759151.660833:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759151.660835:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759151.660837:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759151.660838:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759151.660840:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787759151.660843:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787759151.660846:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787759151.660848:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759151.660849:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759151.660850:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759151.660851:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759151.660853:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759151.660854:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759151.660855:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759151.660856:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759151.660857:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759151.660864:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787759151.660877:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787759151.660885:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293397632:0@lo:253: 00000100:00100000:3.0:1787759151.660917:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.660940:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759151.660987:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759151.660996:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293397248:0@lo:400: 00000100:00100000:1.0:1787759151.661024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759151.661111:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601293396992:0@lo:38: 00000100:00100000:1.0:1787759151.661287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759151.662852:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397504 00000100:00100000:2.0:1787759151.662861:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397504 00000100:00100000:2.0:1787759151.662919:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759151.662929:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775887840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293397504:12345-0@lo:400: 00000100:00100000:2.0:1787759151.662996:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775887840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293397504:12345-0@lo:400: Request processed in 69us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.663004:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787759151.663034:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787759151.663082:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775885680 x1874601293397504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759151.663107:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293397504:0@lo:400: 00000100:00100000:2.0:1787759151.663132:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397632 00000100:00100000:2.0:1787759151.663136:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397632 00000100:00100000:2.0:1787759151.663159:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787759151.663165:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:7614:x1874601293397632:12345-0@lo:253: 20000000:01000000:2.0:1787759151.663185:0:5830:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787759151.663197:0:5830:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787759151.664008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397376 00000100:00100000:3.0:1787759151.664015:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397376 00000100:00100000:1.0:1787759151.664047:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397248 00000100:00100000:1.0:1787759151.664052:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397248 00000100:00100000:3.0:1787759151.664064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293396992 00000100:00100000:3.0:1787759151.664069:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293396992 00000100:00100000:3.0:1787759151.664084:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759151.664091:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293397376:12345-0@lo:400: 00000100:00100000:3.0:1787759151.664144:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293397376:12345-0@lo:400: Request processed in 53us (3433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.664152:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759151.664170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787759151.664174:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759151.664175:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874601293396992:12345-0@lo:38: 00010000:00080000:3.0:1787759151.664197:0:5837:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 115 last 0 00000020:00000080:3.0:1787759151.664245:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x662cc405a6abf4e8 00000004:00100000:3.0:1787759151.664260:0:5837:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787759151.664293:0:5837:0:(import.c:65:import_set_state_nolock()) ffff8d7747b7f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759151.664336:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874601293396992:12345-0@lo:38: Request processed in 160us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.664344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759151.664467:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787759151.664475:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293397248:12345-0@lo:400: 00000100:00100000:1.0:1787759151.664521:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293397248:12345-0@lo:400: Request processed in 46us (3495us total) trans 0 rc 0/0 00010000:00080000:3.0:1787759151.664522:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775885a40 x1874601293397376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759151.664547:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759151.664560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775885a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293397376:0@lo:400: 00010000:00080000:1.0:1787759151.664585:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d7775884f00 x1874601293397248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759151.664597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293397248:0@lo:400: 00010000:00080000:1.0:1787759151.664631:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d776dc4ed00 x1874601293396992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787759161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759151.664639:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787759151.664645:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787759151.664658:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787759151.664663:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787759151.664666:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777c8a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787759151.664672:0:3302:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c92c5bc): req@ffff8d776dc4f840 x1874601293397120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759151.664693:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601293396992:0@lo:38: 00000100:00100000:3.0:1787759151.664771:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.664799:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.666228:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397120 00000100:00100000:2.0:1787759151.666237:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397120 00000100:00080000:3.0:1787759151.666276:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759151.666288:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787759151.666298:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775885a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874601293397120:12345-0@lo:901: 00000100:00100000:2.0:1787759151.666682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775885a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874601293397120:12345-0@lo:901: Request processed in 385us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759151.666690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787759151.668201:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d776dc4f840 x1874601293397120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787759167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759151.668217:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4f840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1874601293397120:0@lo:901: 20000000:01000000:2.0:1787759151.679564:0:5830:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787759151.679578:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787759151.679973:0:5851:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787759151.679978:0:5851:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787759151.679998:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.680016:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf42b expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.680026:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.680064:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.680113:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 14 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.680128:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874601293397760:0@lo:104: 00000100:00100000:1.0:1787759151.680194:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759151.680272:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77516089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759151.680306:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397760 00000100:00100000:2.0:1787759151.680312:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397760 00000100:00100000:2.0:1787759151.680358:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787759151.680497:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5851:x1874601293397760:12345-0@lo:104: 00010000:00010000:2.0:1787759151.680515:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759151.680663:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759151.680669:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:5851:x1874601293397760:12345-0@lo:104: Request processed in 305us (477us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759151.680685:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787759151.680692:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787759151.680692:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.680699:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ea00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759151.680702:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.680710:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759151.680718:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759151.680724:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759151.680767:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.680774:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759151.680807:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.680815:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166ea00/0x662cc405a6abf42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf432 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.680851:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759151.680853:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759151.680854:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759151.680868:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759151.680880:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293397888:0@lo:103: 00000100:00100000:3.0:1787759151.681207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759151.681240:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293397888 00000100:00100000:3.0:1787759151.681244:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293397888 00010000:00010000:3.0:1787759151.681263:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 15 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759151.681292:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759151.681301:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775885680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3306:x1874601293397888:12345-0@lo:103: 00010000:00010000:3.0:1787759151.681312:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759151.681318:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 15 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681328:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 15 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681345:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681352:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787759151.681391:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001386774s 00010000:00010000:3.0:1787759151.681397:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681414:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681421:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681427:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681433:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175000 already unused, calling callback (ffffffffc144d530) 00010000:00010000:3.0:1787759151.681437:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681444:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681454:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759151.681463:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759151.681494:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775885680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3306:x1874601293397888:12345-0@lo:103: Request processed in 195us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759151.681502:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787759151.681550:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775884f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293397888:0@lo:103: 00010000:00010000:1.0:1787759151.681659:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174000/0x662cc405a6abf432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf42b expref: 14 pid: 5829 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.681669:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4ed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5851:1874601293397760:0@lo:104: 00010000:00010000:1.0:1787759151.681688:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.681696:0:5851:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.681702:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759151.681709:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf4ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759151.686683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:7614:x1874601293397632:12345-0@lo:253: Request processed in 23509us (25757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759151.686697:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787759151.687300:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:7614:1874601293397632:0@lo:253: 10000000:01000000:3.0:1787759151.687315:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787759151.687319:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787759151.687322:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787759151.687323:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787759151.687324:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787759151.687325:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787759151.687338:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787759151.687340:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787759151.687341:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787759151.687343:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787759151.687345:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787759151.687346:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787759151.687362:0:7614:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787759151.693549:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759151.693742:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759151.694142:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759151.694547:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787759151.694815:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1787759151.695266:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787759151.697084:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787759151.840429:0:7614:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787759151.840439:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787759151.840480:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787759151.840559:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787759151.840577:0:7614:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787759151.840614:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787759152.272007:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759152.974664:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759152.974684:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293398016:0@lo:13: 00000100:00100000:2.0:1787759152.974744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759152.974931:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398016 00000100:00100000:3.0:1787759152.974938:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398016 00000100:00100000:3.0:1787759152.975289:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787759152.975296:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293398016:12345-0@lo:13: 00002000:00000024:3.0:1787759152.975326:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759152.975389:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293398016:12345-0@lo:13: Request processed in 93us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759152.975395:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787759152.975601:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea3480 x1874601293398016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759152.975615:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293398016:0@lo:13: 00010000:00010000:0.0:1787759153.294527:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759154.318609:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759155.342883:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759155.739285:0:7970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787759156.366780:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759157.070686:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293398144:0@lo:400: 00000100:00100000:3.0:1787759157.070764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759157.070887:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398144 00000100:00100000:1.0:1787759157.070895:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398144 00000100:00100000:1.0:1787759157.070949:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787759157.070961:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3303:x1874601293398144:12345-0@lo:400: 00000100:00100000:0.0:1787759157.071085:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293398272:0@lo:400: 00000100:00100000:0.0:1787759157.071135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759157.071178:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398272 00000100:00100000:0.0:1787759157.071182:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398272 00000100:00100000:0.0:1787759157.071211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787759157.071218:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293398272:12345-0@lo:400: 00000100:00100000:0.0:1787759157.071254:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293398272:12345-0@lo:400: Request processed in 37us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759157.071270:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787759157.071317:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea1e00 x1874601293398272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759157.071332:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293398272:0@lo:400: 00000100:00100000:1.0:1787759157.071804:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3303:x1874601293398144:12345-0@lo:400: Request processed in 845us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759157.071812:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787759157.071898:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293398144:0@lo:400: 00000100:00100000:3.0:1787759157.072044:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293398400:0@lo:400: 00000100:00100000:3.0:1787759157.072072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759157.072159:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398400 00000100:00100000:1.0:1787759157.072163:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398400 00000100:00100000:1.0:1787759157.072198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787759157.072204:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775884f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293398400:12345-0@lo:400: 00000100:00100000:2.0:1787759157.072293:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787759157.072302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293398656:0@lo:400: 00000100:00100000:2.0:1787759157.072332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759157.072357:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398656 00000100:00100000:2.0:1787759157.072361:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398656 00000100:00100000:2.0:1787759157.072401:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759157.072408:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293398656:12345-0@lo:400: 00000100:00100000:2.0:1787759157.072476:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293398656:12345-0@lo:400: Request processed in 68us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759157.072483:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787759157.072519:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea0b40 x1874601293398656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759157.072531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293398656:0@lo:400: 00000100:00080000:0.0:1787759157.072578:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759157.072672:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293398528:0@lo:400: 00000100:00100000:0.0:1787759157.072707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759157.072737:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398528 00000100:00100000:2.0:1787759157.072743:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398528 00000100:00080000:0.0:1787759157.072764:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759157.072783:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787759157.072790:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293398528:12345-0@lo:400: 00000100:00100000:2.0:1787759157.072833:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293398528:12345-0@lo:400: Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759157.072838:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787759157.072927:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea0780 x1874601293398528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759157.072937:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293398528:0@lo:400: 00000100:00100000:1.0:1787759157.073339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775884f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293398400:12345-0@lo:400: Request processed in 1134us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759157.073357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787759157.073453:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea2d00 x1874601293398400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759157.073526:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293398400:0@lo:400: 00010000:00010000:3.0:1787759157.390539:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759158.102581:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293398784:0@lo:13: 00000100:00100000:2.0:1787759158.102647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.103623:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398784 00000100:00100000:0.0:1787759158.103631:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398784 00000100:00100000:0.0:1787759158.103673:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787759158.103682:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293398784:12345-0@lo:13: 00002000:00000024:0.0:1787759158.103716:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759158.103761:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293398784:12345-0@lo:13: Request processed in 81us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.103767:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787759158.103799:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775af04f00 x1874601293398784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759158.103814:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293398784:0@lo:13: 00010000:00010000:2.0:1787759158.415614:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787759158.609434:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787759158.609441:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7773d06800 from 30 10000000:01000000:0.0:1787759158.609446:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787759158.609493:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.609505:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.609516:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.609539:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293398912:0@lo:101: 00000100:00100000:0.0:1787759158.609603:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.609658:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.615055:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293398912 00000100:00100000:1.0:1787759158.615068:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293398912 00000100:00100000:1.0:1787759158.615168:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787759158.615189:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293398912:12345-0@lo:101: 00010000:00010000:1.0:1787759158.615208:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759158.615228:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf4f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.615257:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.615268:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.615277:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174e00, rc 0) 00000100:00100000:1.0:1787759158.615507:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293398912:12345-0@lo:101: Request processed in 330us (5902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.615515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787759158.615589:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293398912:0@lo:101: 00010000:00010000:0.0:1787759158.615608:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.615617:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.615694:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399040:0@lo:501: 00000100:00100000:0.0:1787759158.615724:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.615968:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.616094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399040 00000100:00100000:2.0:1787759158.616099:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399040 00000100:00100000:2.0:1787759158.616119:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787759158.616125:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293399040:12345-0@lo:501: 00000100:00100000:2.0:1787759158.616404:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293399040:12345-0@lo:501: Request processed in 269us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.616411:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787759158.616483:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399040:0@lo:501: 00000100:00100000:0.0:1787759158.616510:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399168:0@lo:503: 00000100:00100000:0.0:1787759158.616546:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.616571:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0180 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.616611:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399168 00000100:00100000:2.0:1787759158.616615:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399168 00000100:00100000:2.0:1787759158.616688:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787759158.616697:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293399168:12345-0@lo:503: 00000100:00100000:2.0:1787759158.616908:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293399168:12345-0@lo:503: Request processed in 212us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.616915:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787759158.619719:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399168:0@lo:503: 00000100:00100000:2.0:1787759158.620074:0:8134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8134:1874601293399296:0@lo:502: 00000100:00100000:2.0:1787759158.620123:0:8134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.620190:0:8134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77600b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759158.620225:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399296 00000100:00100000:0.0:1787759158.620236:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399296 00000100:00100000:0.0:1787759158.620309:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787759158.620317:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8134:x1874601293399296:12345-0@lo:502: 00000100:00100000:0.0:1787759158.620725:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8134:x1874601293399296:12345-0@lo:502: Request processed in 408us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.620733:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787759158.620847:0:8134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8134:1874601293399296:0@lo:502: 00000100:00100000:2.0:1787759158.620887:0:8134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8134:1874601293399424:0@lo:502: 00000100:00100000:2.0:1787759158.620921:0:8134:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.621040:0:8134:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77600b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787759158.621073:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399424 00000100:00100000:0.0:1787759158.621077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399424 00000100:00100000:0.0:1787759158.621108:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787759158.621115:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8134:x1874601293399424:12345-0@lo:502: 00000100:00100000:0.0:1787759158.621233:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8134:x1874601293399424:12345-0@lo:502: Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.621240:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787759158.621307:0:8134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8134:1874601293399424:0@lo:502: 00000040:00080000:2.0:1787759158.621326:0:8134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787759158.622016:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787759158.622034:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759158.622043:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.622053:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759158.622061:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787759158.622063:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787759158.622066:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787759158.622087:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.622093:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.622110:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.622122:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399552:0@lo:101: 00000100:00100000:0.0:1787759158.622148:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.622174:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0900 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.622214:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399552 00000100:00100000:2.0:1787759158.622219:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399552 00000100:00100000:2.0:1787759158.622249:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787759158.622256:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293399552:12345-0@lo:101: 00010000:00010000:2.0:1787759158.622265:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759158.622276:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf504 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.622296:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf504 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.622306:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf504 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.622314:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81200, rc 0) 00000100:00100000:2.0:1787759158.622351:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293399552:12345-0@lo:101: Request processed in 95us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.622357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787759158.622467:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399552:0@lo:101: 00010000:00010000:0.0:1787759158.622478:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.622487:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.622524:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399680:0@lo:501: 00000100:00100000:0.0:1787759158.622548:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.622605:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.626192:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399680 00000100:00100000:3.0:1787759158.626209:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399680 00000100:00100000:3.0:1787759158.626654:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787759158.626664:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293399680:12345-0@lo:501: 00000100:00100000:3.0:1787759158.627053:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293399680:12345-0@lo:501: Request processed in 391us (4503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.627061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787759158.628424:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399680:0@lo:501: 00000100:00100000:3.0:1787759158.628474:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399808:0@lo:503: 00000100:00100000:3.0:1787759158.628522:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.628549:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750a5c000 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.628899:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399808 00000100:00100000:2.0:1787759158.628904:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399808 00000100:00100000:2.0:1787759158.628981:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787759158.628989:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293399808:12345-0@lo:503: 00000100:00100000:2.0:1787759158.629616:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293399808:12345-0@lo:503: Request processed in 627us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.629624:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787759158.629708:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293399808:0@lo:503: 00000100:00100000:3.0:1787759158.630304:0:8136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8136:1874601293399936:0@lo:502: 00000100:00100000:3.0:1787759158.630339:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.630359:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293399936 00000100:00100000:3.0:1787759158.630363:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293399936 00000100:00100000:3.0:1787759158.630412:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787759158.630419:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8136:x1874601293399936:12345-0@lo:502: 00000100:00100000:3.0:1787759158.630571:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8136:x1874601293399936:12345-0@lo:502: Request processed in 152us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.630578:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787759158.630611:0:8136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750a5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.630623:0:8136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8136:1874601293399936:0@lo:502: 00000020:01000000:3.0:1787759158.630655:0:8136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759158.630664:0:8136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759158.630666:0:8136:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787759158.630671:0:8136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787759158.630678:0:8136:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787759158.630698:0:8136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8136:1874601293400064:0@lo:502: 00000100:00100000:3.0:1787759158.630735:0:8136:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.630754:0:8136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750a5cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.631537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400064 00000100:00100000:3.0:1787759158.631542:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400064 00000100:00100000:3.0:1787759158.631564:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787759158.631571:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8136:x1874601293400064:12345-0@lo:502: 00000100:00100000:3.0:1787759158.631976:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8136:x1874601293400064:12345-0@lo:502: Request processed in 404us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.631984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787759158.632774:0:8136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8136:1874601293400064:0@lo:502: 00000020:01000000:1.0:1787759158.632795:0:8136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759158.632801:0:8136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759158.632803:0:8136:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787759158.632809:0:8136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787759158.633436:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787759158.633456:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787759158.633466:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.633477:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759158.633486:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787759158.633489:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7758776000 from 30 10000000:01000000:3.0:1787759158.633491:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787759158.633517:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.633526:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.633534:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759158.633558:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400192:0@lo:101: 00000100:00100000:3.0:1787759158.633593:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.633624:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7760549840 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.633701:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400192 00000100:00100000:1.0:1787759158.633705:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400192 00000100:00100000:1.0:1787759158.633734:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787759158.633741:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293400192:12345-0@lo:101: 00010000:00010000:1.0:1787759158.633759:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759158.633770:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf512 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.633790:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf512 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.633800:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf512 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.633809:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175600, rc 0) 00000100:00100000:1.0:1787759158.633856:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400192:12345-0@lo:101: Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.633863:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787759158.636658:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400192:0@lo:101: 00010000:00010000:3.0:1787759158.636678:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.636689:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759158.637453:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400320:0@lo:501: 00000100:00100000:3.0:1787759158.637501:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.637532:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7760549840 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.637549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400320 00000100:00100000:3.0:1787759158.637554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400320 00000100:00100000:3.0:1787759158.637589:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787759158.637598:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400320:12345-0@lo:501: 00000100:00100000:3.0:1787759158.638038:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400320:12345-0@lo:501: Request processed in 440us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.638046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787759158.638754:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400320:0@lo:501: 00000100:00100000:1.0:1787759158.638787:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400448:0@lo:503: 00000100:00100000:1.0:1787759158.638826:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759158.638847:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c9d5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.638861:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400448 00000100:00100000:1.0:1787759158.638864:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400448 00000100:00100000:1.0:1787759158.638889:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787759158.638896:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400448:12345-0@lo:503: 00000100:00100000:1.0:1787759158.639094:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400448:12345-0@lo:503: Request processed in 198us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.639102:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787759158.639138:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400448:0@lo:503: 00000100:00100000:3.0:1787759158.649383:0:8137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8137:1874601293400576:0@lo:502: 00000100:00100000:3.0:1787759158.649470:0:8137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.649509:0:8137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7760549300 going to sleep for 11 seconds 00000100:00100000:0.0:1787759158.650193:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400576 00000100:00100000:0.0:1787759158.650201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400576 00000100:00100000:0.0:1787759158.650251:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787759158.650261:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8137:x1874601293400576:12345-0@lo:502: 00000100:00100000:0.0:1787759158.650537:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8137:x1874601293400576:12345-0@lo:502: Request processed in 276us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.650545:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787759158.650698:0:8137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8137:1874601293400576:0@lo:502: 00000100:00100000:2.0:1787759158.650763:0:8137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8137:1874601293400704:0@lo:502: 00000100:00100000:2.0:1787759158.650798:0:8137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.650823:0:8137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77600b50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.650906:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400704 00000100:00100000:1.0:1787759158.650917:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400704 00000100:00100000:1.0:1787759158.651184:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787759158.651193:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8137:x1874601293400704:12345-0@lo:502: 00000100:00100000:1.0:1787759158.651529:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8137:x1874601293400704:12345-0@lo:502: Request processed in 337us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.651536:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787759158.651621:0:8137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8137:1874601293400704:0@lo:502: 00000040:00080000:2.0:1787759158.651640:0:8137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787759158.651822:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787759158.651841:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787759158.651851:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.651862:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759158.651977:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787759158.652088:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d7758776000 from 5 10000000:01000000:1.0:1787759158.652091:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787759158.652117:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.652126:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759158.652135:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759158.652148:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400832:0@lo:101: 00000100:00100000:1.0:1787759158.652177:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759158.652406:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c9d5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.652451:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400832 00000100:00100000:2.0:1787759158.652455:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400832 00000100:00100000:2.0:1787759158.652517:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787759158.652523:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293400832:12345-0@lo:101: 00010000:00010000:2.0:1787759158.652532:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759158.652545:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a80e00/0x662cc405a6abf527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf520 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.652566:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a80e00/0x662cc405a6abf527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf520 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.652587:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a80e00/0x662cc405a6abf527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf520 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.652596:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80e00, rc 0) 00000100:00100000:2.0:1787759158.652641:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293400832:12345-0@lo:101: Request processed in 118us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.652647:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787759158.652810:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400832:0@lo:101: 00010000:00010000:0.0:1787759158.652823:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.652837:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.652886:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400960:0@lo:256: 00000100:00100000:0.0:1787759158.652938:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.652957:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.652966:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293400960 00000100:00100000:1.0:1787759158.652975:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293400960 00000100:00100000:1.0:1787759158.653005:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787759158.653012:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293400960:12345-0@lo:256: 20000000:01000000:1.0:1787759158.653025:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787759158.653051:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787759158.653054:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787759158.653134:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293400960:12345-0@lo:256: Request processed in 121us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.653140:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787759158.653579:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293400960:0@lo:256: 10000000:01000000:0.0:1787759158.653618:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787759158.653623:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.653688:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759158.653697:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787759158.653699:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787759158.653701:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787759158.653717:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.653724:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.653731:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.653742:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401088:0@lo:101: 00000100:00100000:0.0:1787759158.653776:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.653806:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.653958:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401088 00000100:00100000:2.0:1787759158.653963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401088 00000100:00100000:2.0:1787759158.653991:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787759158.653998:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293401088:12345-0@lo:101: 00010000:00010000:2.0:1787759158.654005:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759158.654013:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf52e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.654027:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf52e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.654035:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf52e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759158.654042:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81a00, rc 0) 00000100:00100000:2.0:1787759158.654075:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401088:12345-0@lo:101: Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.654082:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787759158.654178:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401088:0@lo:101: 00010000:00010000:0.0:1787759158.654189:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.654210:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.654250:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401216:0@lo:501: 00000100:00100000:0.0:1787759158.654274:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.654294:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.654400:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401216 00000100:00100000:2.0:1787759158.654405:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401216 00000100:00100000:2.0:1787759158.654429:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787759158.654444:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401216:12345-0@lo:501: 00000100:00100000:2.0:1787759158.654798:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401216:12345-0@lo:501: Request processed in 355us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.654806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787759158.654840:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af06580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401216:0@lo:501: 00000100:00100000:1.0:1787759158.654866:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401344:0@lo:503: 00000100:00100000:1.0:1787759158.654901:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759158.654927:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c9d5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.655184:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401344 00000100:00100000:2.0:1787759158.655188:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401344 00000100:00100000:2.0:1787759158.655224:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787759158.655230:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401344:12345-0@lo:503: 00000100:00100000:2.0:1787759158.655553:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401344:12345-0@lo:503: Request processed in 322us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.655560:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787759158.655968:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401344:0@lo:503: 00000100:00100000:1.0:1787759158.658792:0:8138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8138:1874601293401472:0@lo:502: 00000100:00100000:1.0:1787759158.658843:0:8138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759158.659065:0:8138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c9d59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759158.659154:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401472 00000100:00100000:0.0:1787759158.659160:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401472 00000100:00100000:0.0:1787759158.659207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787759158.659215:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8138:x1874601293401472:12345-0@lo:502: 00000100:00100000:0.0:1787759158.659543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8138:x1874601293401472:12345-0@lo:502: Request processed in 328us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.659551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787759158.659852:0:8138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8138:1874601293401472:0@lo:502: 00000020:01000000:3.0:1787759158.659879:0:8138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787759158.659891:0:8138:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787759158.659898:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759158.659900:0:8138:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787759158.659906:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787759158.660010:0:8138:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.138@tcp to nid 0x20000c0a8cc8a (192.168.204.138@tcp) 00000020:01000000:3.0:1787759158.660036:0:8138:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787759158.660039:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787759158.660062:0:8138:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d7747d19a48) 00000020:00000080:3.0:1787759158.660082:0:8138:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787759158.660089:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787759158.660150:0:8138:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787759158.660157:0:8138:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787759158.660173:0:8138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x662cc405a6abf543 00010000:00080000:3.0:1787759158.660201:0:8138:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d777219c000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.138@tcp at head 00010000:00010000:0.0:1787759158.661017:0:8138:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787759158.661693:0:8138:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787759158.661705:0:8138:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787759158.662186:0:8138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759158.662469:0:8138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787759158.662513:0:8138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787759158.662566:0:8138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787759158.662999:0:8139:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787759158.663004:0:8139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787759158.663757:0:8138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787759158.663766:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787759158.663800:0:8138:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787759158.663819:0:8138:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x662cc405a6abf54a 00000100:00080000:0.0:1787759158.663829:0:8138:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787759158.663834:0:8138:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d777219c000 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:0.0:1787759158.663869:0:8138:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d775af07840 x1874601293401600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787759158.663924:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293401600:0@lo:8: 00000100:00100000:1.0:1787759158.663985:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787759158.664041:0:8138:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787759158.664101:0:8138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759158.664105:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759158.664107:0:8138:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787759158.664110:0:8138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759158.664114:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759158.664116:0:8138:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787759158.664119:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787759158.664121:0:8138:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787759158.664143:0:8138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8138:1874601293401728:0@lo:502: 00000100:00100000:0.0:1787759158.664180:0:8138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.664256:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401728 00000100:00100000:0.0:1787759158.664263:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401728 00000100:00100000:0.0:1787759158.664296:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787759158.664303:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8138:x1874601293401728:12345-0@lo:502: 00000100:00100000:0.0:1787759158.664508:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8138:x1874601293401728:12345-0@lo:502: Request processed in 205us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.664516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787759158.664549:0:8138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759158.664564:0:8138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8138:1874601293401728:0@lo:502: 00000020:01000000:0.0:1787759158.664584:0:8138:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759158.664588:0:8138:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759158.664589:0:8138:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787759158.664597:0:8138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787759158.664645:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787759158.664660:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787759158.664669:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.664679:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759158.664689:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787759158.664692:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7746458000 from 1 10000000:01000000:0.0:1787759158.664695:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759158.664716:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.664723:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.664731:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759158.664742:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401856:0@lo:101: 00000100:00100000:0.0:1787759158.664767:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759158.664780:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721c0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.664941:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293402112:0@lo:400: 00000100:00100000:3.0:1787759158.664974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.664996:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759158.665002:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601293401984:0@lo:400: 00000100:00100000:3.0:1787759158.665023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.665046:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293402240:0@lo:400: 00000100:00100000:3.0:1787759158.665066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.665092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402112 00000100:00100000:3.0:1787759158.665096:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402112 00000100:00100000:3.0:1787759158.665121:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401984 00000100:00100000:3.0:1787759158.665124:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401984 00000100:00100000:3.0:1787759158.665133:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402240 00000100:00100000:3.0:1787759158.665135:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402240 00000100:00100000:3.0:1787759158.665146:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759158.665152:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293402112:12345-0@lo:400: 00000100:00100000:3.0:1787759158.665194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874601293402112:12345-0@lo:400: Request processed in 41us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.665200:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787759158.665212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759158.665218:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601293401984:12345-0@lo:400: 00000100:00100000:3.0:1787759158.665240:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e41680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874601293401984:12345-0@lo:400: Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.665245:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759158.665254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759158.665260:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293402240:12345-0@lo:400: 00000100:00100000:3.0:1787759158.665283:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e41a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293402240:12345-0@lo:400: Request processed in 23us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.665288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787759158.665315:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7752e42d00 x1874601293402240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.665325:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e42d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293402240:0@lo:400: 00010000:00080000:3.0:1787759158.665344:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7775886940 x1874601293401984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.665351:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7775886940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874601293401984:0@lo:400: 00010000:00080000:3.0:1787759158.665359:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7752e43840 x1874601293402112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.665409:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874601293402112:0@lo:400: 00000100:00100000:2.0:1787759158.665555:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401600 00000100:00100000:2.0:1787759158.665560:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401600 00000100:00100000:2.0:1787759158.665579:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787759158.665584:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874601293401600:12345-0@lo:8: 00010000:00080000:2.0:1787759158.665603:0:6679:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 122 last 0 00000020:00000080:2.0:1787759158.665624:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x662cc405a6abf558 00002000:00100000:2.0:1787759158.665635:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d7642863800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113969 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787759158.665640:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787759158.665643:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787759158.665727:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787759158.665847:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787759158.665870:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d7642862000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787759158.666307:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874601293401600:12345-0@lo:8: Request processed in 721us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.666321:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787759158.666476:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293401856 00000100:00100000:0.0:1787759158.666480:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293401856 00000100:00100000:0.0:1787759158.666510:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787759158.666517:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293401856:12345-0@lo:101: 00010000:00010000:0.0:1787759158.666525:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759158.666536:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf551 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.666562:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.666572:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759158.666581:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7740030800, rc 0) 00000100:00100000:0.0:1787759158.666658:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293401856:12345-0@lo:101: Request processed in 141us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759158.666664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787759158.666766:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293401856:0@lo:101: 00010000:00010000:3.0:1787759158.666780:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.666794:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759158.666835:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293402368:0@lo:501: 00000100:00100000:3.0:1787759158.666860:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.666915:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7760549180 going to sleep for 11 seconds 00010000:00080000:1.0:1787759158.666977:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775af07840 x1874601293401600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787759168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759158.666986:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787759158.666992:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787759158.666999:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787759158.667003:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787759158.667006:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777219c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787759158.667028:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787759158.667034:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293401600:0@lo:8: 00000004:00080000:3.0:1787759158.667182:0:8139:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787759158.667308:0:8139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 122907940441ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787759158.667608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402368 00000100:00100000:0.0:1787759158.667612:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402368 00000100:00100000:0.0:1787759158.667642:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787759158.667649:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293402368:12345-0@lo:501: 00000100:00100000:0.0:1787759158.667836:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293402368:12345-0@lo:501: Request processed in 187us (974us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787759158.667844:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787759158.667927:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e43840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293402368:0@lo:501: 10000000:01000000:3.0:1787759158.667951:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787759158.667957:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759158.667964:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787759158.725543:0:8140:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787759158.725576:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402624:0@lo:7: 00000100:00100000:2.0:1787759158.725647:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.725921:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721a6d80 going to sleep for 11 seconds 00000004:00080000:2.0:1787759158.725981:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787759158.726023:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402624 00000100:00100000:2.0:1787759158.726031:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402624 00000100:00100000:2.0:1787759158.726210:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787759158.726222:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8140:x1874601293402624:12345-0@lo:7: 00000100:00100000:3.0:1787759158.728054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293402496:0@lo:13: 00000100:00100000:3.0:1787759158.728104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.728307:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402496 00000100:00100000:3.0:1787759158.728312:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402496 00000100:00100000:3.0:1787759158.728347:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787759158.728355:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874601293402496:12345-0@lo:13: 00002000:00000024:3.0:1787759158.728746:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787759158.728831:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e42d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874601293402496:12345-0@lo:13: Request processed in 476us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759158.728839:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787759158.728967:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea21c0 x1874601293402496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759158.728985:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293402496:0@lo:13: 00000100:00080000:3.0:1787759158.729445:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787759158.737511:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787759158.737519:0:6682:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787759158.737605:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8140:x1874601293402624:12345-0@lo:7: Request processed in 11382us (11953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759158.737619:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787759158.737832:0:8140:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea2580 x1874601293402624/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787759174 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759158.737848:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402624:0@lo:7: 00000004:00080000:2.0:1787759158.737863:0:8140:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787759158.737904:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402752:0@lo:5: 00000100:00100000:2.0:1787759158.737941:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.737985:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777d955240 going to sleep for 11 seconds 00000100:00100000:3.0:1787759158.738523:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402752 00000100:00100000:3.0:1787759158.738530:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402752 00000100:00100000:3.0:1787759158.738573:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759158.738582:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8140:x1874601293402752:12345-0@lo:5: 00002000:00080000:3.0:1787759158.738605:0:6679:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787759158.738609:0:6679:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787759158.739081:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8140:x1874601293402752:12345-0@lo:5: Request processed in 500us (1138us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787759158.739087:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787759158.739327:0:8140:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea2580 x1874601293402752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759174 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759158.739339:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402752:0@lo:5: 00000004:00080000:2.0:1787759158.739349:0:8140:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787759158.739409:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402880:0@lo:700: 00000100:00100000:2.0:1787759158.739435:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.739469:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777d955240 going to sleep for 11 seconds 00000100:00100000:2.0:1787759158.739491:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293402880 00000100:00100000:2.0:1787759158.739495:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293402880 00000100:00100000:2.0:1787759158.739533:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759158.739542:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8140:x1874601293402880:12345-0@lo:700: 00000100:00100000:2.0:1787759158.739570:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874601293403008:0@lo:700: 00000100:00100000:2.0:1787759158.739595:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759158.739617:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777d955f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.740007:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403008 00000100:00100000:1.0:1787759158.740012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403008 00000100:00100000:1.0:1787759158.740045:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787759158.740051:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874601293403008:12345-0@lo:700: 40000000:02000000:1.0:1787759158.779205:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787759158.782904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1874601293403008:12345-0@lo:700: Request processed in 42847us (43302us total) trans 0 rc 0/0 00010000:00080000:2.0:1787759158.782914:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea0780 x1874601293403008/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787759174 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759158.782916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787759158.782928:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1874601293403008:0@lo:700: 40000000:02000000:2.0:1787759158.782941:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1787759158.851721:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8140:x1874601293402880:12345-0@lo:700: Request processed in 112173us (112277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759158.851735:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787759158.851780:0:8140:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea0b40 x1874601293402880/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787759174 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.851797:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293402880:0@lo:700: 00000001:00100000:0.0:1787759158.852038:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787759158.852052:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:3.0:1787759158.894777:0:8140:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787759158.900112:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7752e40b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293403136:0@lo:5: 00000100:00100000:3.0:1787759158.900236:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759158.900417:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7760549c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787759158.900839:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403136 00000100:00100000:1.0:1787759158.900846:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403136 00000100:00100000:1.0:1787759158.900997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787759158.901008:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8140:x1874601293403136:12345-0@lo:5: 00002000:00080000:1.0:1787759158.907532:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787759158.907553:0:6682:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787759158.911304:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8140:x1874601293403136:12345-0@lo:5: Request processed in 10292us (11062us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787759158.911319:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787759158.911430:0:8140:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7752e40b40 x1874601293403136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759174 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.911442:0:8140:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787759158.911456:0:8140:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d7752e40b40 x1874601293403136/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787759174 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759158.911468:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7752e40b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8140:1874601293403136:0@lo:5: 00000004:00080000:3.0:1787759158.911483:0:8140:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:1.0:1787759159.250242:0:7631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787759159.440774:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759159.565282:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759159.565681:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281847424 00000100:00100000:3.0:1787759159.565691:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281847424 00000100:00100000:3.0:1787759159.565754:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:3.0:1787759159.565761:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2380:x1874601281847424:12345-192.168.204.38@tcp:250: 00010000:00080000:3.0:1787759159.565789:0:5829:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2f3fdd18-fa03-418f-9660-ec3aa1731f1a@192.168.204.38@tcp t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:3.0:1787759159.565824:0:5829:0:(genops.c:1385:class_connect()) connect: client 2f3fdd18-fa03-418f-9660-ec3aa1731f1a, cookie 0x662cc405a6abf566 00000100:00080000:3.0:1787759159.566076:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8d777219b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759159.566156:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+5:2380:x1874601281847424:12345-192.168.204.38@tcp:250: Request processed in 393us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759159.566165:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 106 00000100:00100000:0.0:1787759159.568786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759159.568894:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281847552 00000100:00100000:1.0:1787759159.568903:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281847552 00000100:00100000:1.0:1787759159.568997:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:1.0:1787759159.569006:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+5:5602:x1874601281847552:12345-192.168.204.38@tcp:101: 00010000:00010000:1.0:1787759159.569022:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759159.569039:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7634fd9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759159.569066:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759159.569077:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759159.569086:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174000, rc 0) 00000100:00100000:1.0:1787759159.569139:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+6:5602:x1874601281847552:12345-192.168.204.38@tcp:101: Request processed in 133us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759159.569146:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 107 00000100:00100000:1.0:1787759159.572849:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759159.572935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281847680 00000100:00100000:3.0:1787759159.572944:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281847680 00000100:00100000:3.0:1787759159.572996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:3.0:1787759159.573006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+6:5602:x1874601281847680:12345-192.168.204.38@tcp:501: 00000100:00100000:3.0:1787759159.573342:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+6:5602:x1874601281847680:12345-192.168.204.38@tcp:501: Request processed in 336us (501us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787759159.573351:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 108 00000100:00100000:3.0:1787759159.577493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759159.577541:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281847808 00000100:00100000:3.0:1787759159.577549:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281847808 00000100:00100000:3.0:1787759159.577600:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:3.0:1787759159.577609:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+6:5602:x1874601281847808:12345-192.168.204.38@tcp:101: 00010000:00010000:3.0:1787759159.577625:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759159.577642:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7634fe0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759159.577668:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759159.577691:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759159.577701:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166ea00, rc 0) 00000100:00100000:3.0:1787759159.577755:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+7:5602:x1874601281847808:12345-192.168.204.38@tcp:101: Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759159.577763:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 109 00000100:00100000:0.0:1787759159.584294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759159.584393:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281847936 00000100:00100000:1.0:1787759159.584402:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281847936 00000100:00100000:1.0:1787759159.584454:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:1.0:1787759159.584464:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+7:5602:x1874601281847936:12345-192.168.204.38@tcp:501: 00000100:00100000:1.0:1787759159.584809:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5602:x1874601281847936:12345-192.168.204.38@tcp:501: Request processed in 345us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759159.584827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 110 00000100:00100000:0.0:1787759159.587768:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759159.593180:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848064 00000100:00100000:3.0:1787759159.593195:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848064 00000100:00100000:3.0:1787759159.593261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 111 00000100:00100000:3.0:1787759159.593274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5602:x1874601281848064:12345-192.168.204.38@tcp:503: 00000100:00100000:3.0:1787759159.594326:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5602:x1874601281848064:12345-192.168.204.38@tcp:503: Request processed in 1042us (6550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759159.594338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 111 00000100:00100000:1.0:1787759159.601828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759159.602026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848192 00000100:00100000:0.0:1787759159.602036:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848192 00000100:00100000:0.0:1787759159.602164:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:0.0:1787759159.602174:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5621:x1874601281848192:12345-192.168.204.38@tcp:502: 00000100:00100000:0.0:1787759159.602538:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5621:x1874601281848192:12345-192.168.204.38@tcp:502: Request processed in 364us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759159.602546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 112 00000100:00100000:1.0:1787759159.629952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.630120:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848320 00000100:00100000:2.0:1787759159.630134:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848320 00000100:00100000:2.0:1787759159.630192:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:2.0:1787759159.630201:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5621:x1874601281848320:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1787759159.630517:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5621:x1874601281848320:12345-192.168.204.38@tcp:502: Request processed in 314us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.630526:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 113 00000100:00100000:1.0:1787759159.636212:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759159.636309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848448 00000100:00100000:0.0:1787759159.636406:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848448 00000100:00100000:0.0:1787759159.636464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:0.0:1787759159.636474:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5602:x1874601281848448:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1787759159.636493:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759159.636512:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7740031600/0x662cc405a6abf57b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f763500a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759159.636548:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7740031600/0x662cc405a6abf57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763500a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759159.636560:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7740031600/0x662cc405a6abf57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763500a expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759159.636570:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7740031600, rc 0) 00000100:00100000:0.0:1787759159.636625:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5602:x1874601281848448:12345-192.168.204.38@tcp:101: Request processed in 152us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759159.636632:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 114 00000100:00100000:1.0:1787759159.640327:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.640430:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848576 00000100:00100000:2.0:1787759159.640440:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848576 00000100:00100000:2.0:1787759159.640592:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:2.0:1787759159.640603:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5602:x1874601281848576:12345-192.168.204.38@tcp:256: 20000000:01000000:2.0:1787759159.640628:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787759159.640648:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787759159.640652:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787759159.640656:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787759159.640658:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787759159.643229:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5602:x1874601281848576:12345-192.168.204.38@tcp:256: Request processed in 2619us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.643242:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 115 00000100:00100000:2.0:1787759159.646587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.646617:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848704 00000100:00100000:2.0:1787759159.646624:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848704 00000100:00100000:2.0:1787759159.646900:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:2.0:1787759159.646909:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5602:x1874601281848704:12345-192.168.204.38@tcp:101: 00010000:00010000:2.0:1787759159.646926:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759159.646943:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7635011 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759159.646970:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759159.646983:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759159.646993:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81e00, rc 0) 00000100:00100000:2.0:1787759159.647040:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5602:x1874601281848704:12345-192.168.204.38@tcp:101: Request processed in 131us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.647049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 116 00000100:00100000:1.0:1787759159.648557:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.649912:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848832 00000100:00100000:2.0:1787759159.649921:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848832 00000100:00100000:2.0:1787759159.650003:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:2.0:1787759159.650023:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5602:x1874601281848832:12345-192.168.204.38@tcp:501: 00000100:00100000:2.0:1787759159.650258:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5602:x1874601281848832:12345-192.168.204.38@tcp:501: Request processed in 235us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.650267:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 117 00000100:00100000:2.0:1787759159.653998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759159.654113:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281848960 00000100:00100000:0.0:1787759159.654122:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281848960 00000100:00100000:0.0:1787759159.654273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:0.0:1787759159.654284:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5602:x1874601281848960:12345-192.168.204.38@tcp:503: 00000100:00100000:0.0:1787759159.654645:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5602:x1874601281848960:12345-192.168.204.38@tcp:503: Request processed in 363us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759159.654662:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 118 00000100:00100000:0.0:1787759159.658019:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.658066:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849088 00000100:00100000:2.0:1787759159.658075:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849088 00000100:00100000:2.0:1787759159.658135:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:2.0:1787759159.658145:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5628:x1874601281849088:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1787759159.658433:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5628:x1874601281849088:12345-192.168.204.38@tcp:502: Request processed in 288us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.658441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 119 00000100:00100000:2.0:1787759159.661177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.661214:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849216 00000100:00100000:2.0:1787759159.661222:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849216 00000100:00100000:2.0:1787759159.661264:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:2.0:1787759159.661274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5628:x1874601281849216:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1787759159.661595:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5628:x1874601281849216:12345-192.168.204.38@tcp:502: Request processed in 322us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.661603:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 120 00000100:00100000:0.0:1787759159.664877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759159.665003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849344 00000100:00100000:2.0:1787759159.665011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849344 00000100:00100000:2.0:1787759159.665052:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1787759159.665059:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2380:x1874601281849344:12345-192.168.204.38@tcp:38: 00010000:00080000:2.0:1787759159.665088:0:5836:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from e27cd7ed-1056-4119-a592-11d825b15827@192.168.204.38@tcp t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:2.0:1787759159.665142:0:5836:0:(genops.c:1385:class_connect()) connect: client e27cd7ed-1056-4119-a592-11d825b15827, cookie 0x662cc405a6abf589 00000004:00100000:2.0:1787759159.665170:0:5836:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787759159.665176:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787759159.688829:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d7642866800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787759159.689144:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+6:2380:x1874601281849344:12345-192.168.204.38@tcp:38: Request processed in 24081us (24271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759159.689154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00010000:00010000:3.0:1787759160.462908:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759160.691553:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759160.691645:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849472 00000100:00100000:3.0:1787759160.691654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849472 00000100:00100000:3.0:1787759160.691824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:3.0:1787759160.691835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:0:x1874601281849472:12345-192.168.204.38@tcp:41: 00000004:00000024:3.0:1787759160.691880:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1787759160.691909:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759160.691953:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:0:x1874601281849472:12345-192.168.204.38@tcp:41: Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759160.691961:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:3.0:1787759160.693102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759160.693186:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849600 00000100:00100000:0.0:1787759160.693192:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849600 00000100:00100000:0.0:1787759160.693244:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1787759160.693253:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281849600:12345-192.168.204.38@tcp:41: 00000004:00000024:0.0:1787759160.693331:0:6792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787759160.693429:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281849600:12345-192.168.204.38@tcp:41: Request processed in 178us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759160.693437:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:0.0:1787759160.696808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759160.696969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849728 00000100:00100000:3.0:1787759160.696997:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849728 00000100:00100000:3.0:1787759160.697132:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:3.0:1787759160.697144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281849728:12345-192.168.204.38@tcp:40: 00000100:00100000:3.0:1787759160.697255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281849728:12345-192.168.204.38@tcp:40: Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759160.697263:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1787759160.700271:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759160.700415:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759160.700570:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850240 00000100:00100000:3.0:1787759160.700582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850240 00000100:00100000:3.0:1787759160.700649:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1787759160.700661:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281850240:12345-192.168.204.38@tcp:33: 00000100:00100000:3.0:1787759160.702821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759160.703539:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849856 00000100:00100000:1.0:1787759160.703554:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849856 00000100:00100000:1.0:1787759160.703617:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1787759160.703628:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2380:x1874601281849856:12345-192.168.204.38@tcp:8: 00010000:00080000:1.0:1787759160.703669:0:6681:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e27cd7ed-1056-4119-a592-11d825b15827@192.168.204.38@tcp t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:1.0:1787759160.703710:0:6681:0:(genops.c:1385:class_connect()) connect: client e27cd7ed-1056-4119-a592-11d825b15827, cookie 0x662cc405a6abf590 00002000:00100000:1.0:1787759160.703726:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e27cd7ed-1056-4119-a592-11d825b15827/ffff8d7641c84000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787759160.703756:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787759160.704188:0:6681:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787759160.704229:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8d7641c87000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787759160.704332:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e43840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+6:2380:x1874601281849856:12345-192.168.204.38@tcp:8: Request processed in 703us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759160.704341:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:3.0:1787759160.704944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759160.705067:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850112 00000100:00100000:3.0:1787759160.705073:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850112 00000100:00100000:3.0:1787759160.705107:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:3.0:1787759160.705115:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7775886940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2380:x1874601281850112:12345-192.168.204.38@tcp:8: 00010000:00080000:3.0:1787759160.705139:0:6682:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from e27cd7ed-1056-4119-a592-11d825b15827@192.168.204.38@tcp t0 exp 0000000000000000 cur 124 last 0 00000020:00000080:3.0:1787759160.705166:0:6682:0:(genops.c:1385:class_connect()) connect: client e27cd7ed-1056-4119-a592-11d825b15827, cookie 0x662cc405a6abf597 00002000:00100000:3.0:1787759160.705176:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e27cd7ed-1056-4119-a592-11d825b15827/ffff8d7772199800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787759160.705184:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787759160.706767:0:6682:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787759160.706819:0:6682:0:(import.c:65:import_set_state_nolock()) ffff8d777219f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759160.706917:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7775886940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2380:x1874601281850112:12345-192.168.204.38@tcp:8: Request processed in 1799us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759160.706929:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:2.0:1787759160.707520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281849984 00000100:00100000:2.0:1787759160.707531:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281849984 00000100:00100000:2.0:1787759160.707583:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 121 00000100:00100000:2.0:1787759160.707604:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2382:x1874601281849984:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1787759160.707658:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2382:x1874601281849984:12345-192.168.204.38@tcp:400: Request processed in 67us (7400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759160.707665:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 121 00000004:00080000:3.0:1787759160.734409:0:5838:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33657us 00000004:00200000:3.0:1787759160.752886:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787759160.753297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:5602:x1874601281850240:12345-192.168.204.38@tcp:33: Request processed in 52632us (52875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759160.753310:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:1.0:1787759160.877255:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759160.877468:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850368 00000100:00100000:0.0:1787759160.877477:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850368 00000100:00100000:0.0:1787759160.877538:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:0.0:1787759160.877553:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+6:5645:x1874601281850368:12345-192.168.204.38@tcp:101: 00010000:00010000:0.0:1787759160.877575:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759160.877640:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7740030c00/0x662cc405a6abf59e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763503b expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.877726:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.877740:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.877755:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787759160.877949:0:6792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787759160.877954:0:6792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787759160.878027:0:6792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.878054:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7740030c00/0x662cc405a6abf59e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763503b expref: 8 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.878072:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763503b expref: 7 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759160.878081:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7743c92800) 00010000:00010000:0.0:1787759160.878084:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787759160.878088:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77609e2400, rc 0) 00000100:00100000:0.0:1787759160.878151:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+7:5645:x1874601281850368:12345-192.168.204.38@tcp:101: Request processed in 604us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759160.878159:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00010000:00010000:2.0:1787759161.487618:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759162.510541:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759162.613787:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759162.613894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850496 00000100:00100000:0.0:1787759162.613902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850496 00000100:00100000:0.0:1787759162.613976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:0.0:1787759162.613997:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+7:5697:x1874601281850496:12345-192.168.204.38@tcp:41: 00000004:00000024:0.0:1787759162.614037:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787759162.614099:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+7:5697:x1874601281850496:12345-192.168.204.38@tcp:41: Request processed in 104us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759162.614106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00080000:3.0:1787759162.614167:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759162.618247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759162.618328:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850624 00000100:00100000:3.0:1787759162.618336:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850624 00000100:00100000:3.0:1787759162.618430:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:3.0:1787759162.618440:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e27cd7ed-1056-4119-a592-11d825b15827+6:5697:x1874601281850624:12345-192.168.204.38@tcp:13: 00002000:00000024:3.0:1787759162.618470:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759162.618514:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e27cd7ed-1056-4119-a592-11d825b15827+6:5697:x1874601281850624:12345-192.168.204.38@tcp:13: Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759162.618521:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00080000:0.0:1787759162.618581:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759162.620941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759162.621430:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850752 00000100:00100000:3.0:1787759162.621436:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850752 00000100:00100000:3.0:1787759162.621514:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:3.0:1787759162.621523:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e27cd7ed-1056-4119-a592-11d825b15827+6:5697:x1874601281850752:12345-192.168.204.38@tcp:13: 00002000:00000024:3.0:1787759162.621551:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759162.621601:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e27cd7ed-1056-4119-a592-11d825b15827+6:5697:x1874601281850752:12345-192.168.204.38@tcp:13: Request processed in 79us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759162.621608:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00080000:0.0:1787759162.621658:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787759163.215312:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293403264:0@lo:13: 00000100:00100000:0.0:1787759163.215464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759163.215606:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403264 00000100:00100000:3.0:1787759163.215613:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403264 00000100:00100000:3.0:1787759163.215726:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787759163.215736:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293403264:12345-0@lo:13: 00002000:00000024:3.0:1787759163.215761:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759163.215815:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293403264:12345-0@lo:13: Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759163.215822:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787759163.218031:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea2580 x1874601293403264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759163.218057:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293403264:0@lo:13: 00000100:00080000:2.0:1787759163.218648:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787759163.535017:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759163.727810:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293403392:0@lo:400: 00000100:00100000:1.0:1787759163.727896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759163.728132:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403392 00000100:00100000:2.0:1787759163.728140:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403392 00000100:00100000:2.0:1787759163.728189:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787759163.728198:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3306:x1874601293403392:12345-0@lo:400: 00000100:00100000:1.0:1787759163.728206:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293403648:0@lo:400: 00000100:00100000:1.0:1787759163.728243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759163.728254:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3306:x1874601293403392:12345-0@lo:400: Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759163.728261:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787759163.728269:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787759163.728304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403648 00000100:00100000:2.0:1787759163.728308:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403648 00000100:00100000:2.0:1787759163.728348:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787759163.728354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293403648:12345-0@lo:400: 00000100:00100000:2.0:1787759163.728399:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293403648:12345-0@lo:400: Request processed in 46us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759163.728406:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787759163.728422:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759163.728429:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293403520:0@lo:400: 00000100:00100000:1.0:1787759163.728460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759163.728500:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293403648:0@lo:400: 00000100:00100000:1.0:1787759163.728528:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293403776:0@lo:400: 00000100:00100000:1.0:1787759163.728554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759163.728575:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759163.728582:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293403904:0@lo:400: 00000100:00100000:1.0:1787759163.728611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759163.728640:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403520 00000100:00100000:1.0:1787759163.728643:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403520 00000100:00100000:1.0:1787759163.728666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403776 00000100:00100000:1.0:1787759163.728669:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403776 00000100:00100000:1.0:1787759163.728689:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759163.728695:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293403520:12345-0@lo:400: 00000100:00100000:1.0:1787759163.728793:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293403520:12345-0@lo:400: Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759163.728801:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759163.728817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759163.728824:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293403776:12345-0@lo:400: 00000100:00100000:1.0:1787759163.728914:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293403776:12345-0@lo:400: Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759163.728930:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787759163.728951:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293403904 00000100:00100000:1.0:1787759163.728955:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293403904 00000100:00100000:1.0:1787759163.728988:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787759163.728995:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293403904:12345-0@lo:400: 00000100:00100000:1.0:1787759163.729026:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293403904:12345-0@lo:400: Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759163.729032:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787759163.729064:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776dc4f480 x1874601293403904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759163.729073:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787759163.729088:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293403904:0@lo:400: 00000100:00100000:1.0:1787759163.729103:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293403776:0@lo:400: 00000100:00100000:1.0:1787759163.729126:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293403520:0@lo:400: 00000100:00100000:1.0:1787759163.729143:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293403392:0@lo:400: 00000100:00080000:1.0:1787759163.729183:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759163.729187:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787759163.754729:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000001:02000400:2.0:1787759164.144058:0:8280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787759164.240093:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759164.240116:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293404032:0@lo:13: 00000100:00100000:3.0:1787759164.240177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759164.240229:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404032 00000100:00100000:3.0:1787759164.240235:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404032 00000100:00100000:3.0:1787759164.240272:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787759164.240280:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775afc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293404032:12345-0@lo:13: 00002000:00000024:3.0:1787759164.240324:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759164.240363:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775afc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293404032:12345-0@lo:13: Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759164.240386:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787759164.240424:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775afc4000 x1874601293404032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759164.240441:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293404032:0@lo:13: 00010000:00010000:2.0:1787759164.562688:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787759164.786903:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000001:00100000:3.0:1787759165.317172:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00010000:00010000:0.0:1787759165.585991:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759165.758197:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759165.758464:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759165.758501:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759165.758527:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759165.758555:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851008 00000100:00100000:1.0:1787759165.758564:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851008 00000100:00100000:1.0:1787759165.758625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1787759165.758643:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:2384:x1874601281851008:12345-192.168.204.38@tcp:400: 00000100:00100000:1.0:1787759165.758718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:2384:x1874601281851008:12345-192.168.204.38@tcp:400: Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759165.758726:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1787759165.758749:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851136 00000100:00100000:1.0:1787759165.758753:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851136 00000100:00100000:1.0:1787759165.758777:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851264 00000100:00100000:1.0:1787759165.758780:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851264 00000100:00100000:1.0:1787759165.758796:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1787759165.758802:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2383:x1874601281851136:12345-192.168.204.38@tcp:400: 00000100:00100000:1.0:1787759165.758828:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2383:x1874601281851136:12345-192.168.204.38@tcp:400: Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759165.758834:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:1.0:1787759165.758846:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:1.0:1787759165.758852:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281851264:12345-192.168.204.38@tcp:400: 00000100:00100000:1.0:1787759165.758875:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281851264:12345-192.168.204.38@tcp:400: Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759165.758882:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00080000:1.0:1787759165.758897:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787759165.758900:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787759165.758902:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759165.761412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281850880 00000100:00100000:2.0:1787759165.761424:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281850880 00000100:00100000:2.0:1787759165.761472:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 123 00000100:00100000:2.0:1787759165.761481:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2383:x1874601281850880:12345-192.168.204.38@tcp:400: 00000100:00100000:2.0:1787759165.761543:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2383:x1874601281850880:12345-192.168.204.38@tcp:400: Request processed in 63us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759165.761551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 123 00000020:00000080:2.0:1787759166.193831:0:8429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd622f5210 20000000:00000080:2.0:1787759166.193848:0:8429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d7748475000 uarg=0000000000000000 20000000:01000000:2.0:1787759166.193883:0:8429:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787759166.193886:0:8429:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787759166.193889:0:8429:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787759166.193894:0:8429:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787759166.193899:0:8429:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787759166.193913:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787759166.193915:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787759166.194109:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787759166.194112:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787759166.195629:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787759166.196105:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787759166.196150:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787759166.196194:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787759166.196213:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787759166.196216:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787759166.199311:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787759166.199821:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787759166.199893:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787759166.199933:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787759166.199947:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787759166.199950:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759166.200909:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787759166.201280:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787759166.201341:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787759166.201489:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787759166.201503:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787759166.201506:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787759166.202164:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787759166.202678:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787759166.202842:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787759166.202884:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1787759166.202901:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787759166.202920:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202937:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202945:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202952:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202967:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf504 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202974:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202982:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf52e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202988:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf551 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.202997:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203004:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203012:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203049:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203064:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 9 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.203080:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404160:192.168.204.38@tcp:104: 00010000:00010000:0.0:1787759166.203222:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203237:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 9 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.203258:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404288:192.168.204.38@tcp:104: 00010000:00010000:0.0:1787759166.203290:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203299:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 18 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.203308:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af043c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404416:0@lo:104: 00000100:00100000:0.0:1787759166.203344:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759166.203410:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203419:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.203427:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404544:0@lo:104: 00000100:00100000:0.0:1787759166.203447:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759166.203472:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.203480:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.203493:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404672:0@lo:104: 00000100:00100000:0.0:1787759166.203518:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.203602:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404416 00000100:00100000:3.0:1787759166.203604:0:6314:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787759166.203609:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404416 00000100:00100000:3.0:1787759166.203617:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404544 00000100:00100000:3.0:1787759166.203623:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404544 00000100:00100000:2.0:1787759166.203648:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404672 00000100:00100000:2.0:1787759166.203653:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404672 00000100:00100000:3.0:1787759166.203654:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759166.203666:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8429:x1874601293404416:12345-0@lo:104: 00000100:00100000:2.0:1787759166.203676:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787759166.203679:0:6314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.203685:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8429:x1874601293404544:12345-0@lo:104: 00010000:00010000:2.0:1787759166.203700:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.203849:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787759166.203856:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af07840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8429:x1874601293404416:12345-0@lo:104: Request processed in 193us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.203863:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759166.203882:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759166.203891:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc48c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293404672:12345-0@lo:104: 00010000:00010000:3.0:1787759166.203898:0:6314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.203933:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787759166.203938:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc48c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293404672:12345-0@lo:104: Request processed in 50us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.203944:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1787759166.203963:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787759166.203969:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.203976:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740031a00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759166.203980:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204000:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759166.204008:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759166.204014:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787759166.204032:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204045:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 18 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.204054:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404800:0@lo:104: 00010000:00010000:3.0:1787759166.204061:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204070:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787759166.204083:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759166.204108:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204118:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.204126:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405056:0@lo:104: 00000100:00100000:0.0:1787759166.204144:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.204163:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404800 00000100:00100000:0.0:1787759166.204167:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404800 00000100:00100000:0.0:1787759166.204182:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405056 00000100:00100000:0.0:1787759166.204185:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405056 00000100:00100000:0.0:1787759166.204195:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787759166.204200:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8429:x1874601293404800:12345-0@lo:104: 00010000:00010000:0.0:1787759166.204209:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204240:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759166.204257:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8429:x1874601293404800:12345-0@lo:104: Request processed in 45us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.204264:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787759166.204277:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787759166.204290:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405056:12345-0@lo:104: 00010000:00010000:0.0:1787759166.204299:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204330:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1787759166.204331:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.204338:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405056:12345-0@lo:104: Request processed in 47us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759166.204345:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740031a00/0x662cc405a6abf551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf55f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.204350:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787759166.204389:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787759166.204393:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204400:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166f200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759166.204403:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204406:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759166.204414:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204415:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204433:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740031000 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759166.204435:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759166.204440:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759166.204443:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787759166.204455:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759166.204462:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759166.204467:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787759166.204473:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204480:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759166.204488:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204492:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204499:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759166.204508:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204526:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740031000/0x662cc405a6abf504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf50b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204535:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759166.204538:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204544:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740030a00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759166.204548:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204555:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759166.204562:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759166.204568:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787759166.204581:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204587:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759166.204593:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204600:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740030a00/0x662cc405a6abf4f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4fd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204609:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759166.204615:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759166.204617:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759166.204635:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.204645:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.204654:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405568:0@lo:104: 00000100:00100000:0.0:1787759166.204678:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.204699:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405568 00000100:00100000:0.0:1787759166.204702:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405568 00000100:00100000:0.0:1787759166.204721:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787759166.204774:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf519 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.204785:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759166.204789:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759166.204791:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759166.204793:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776deded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405568:12345-0@lo:104: 00010000:00010000:0.0:1787759166.204803:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.204807:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775afc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293404928:0@lo:103: 00000100:00100000:1.0:1787759166.204908:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293405440:0@lo:103: 00010000:00010000:0.0:1787759166.205110:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787759166.205116:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776deded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405568:12345-0@lo:104: Request processed in 328us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.205123:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787759166.205135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759166.205140:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759166.205146:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205154:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759166.205158:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205165:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759166.205181:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759166.205187:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787759166.205190:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293404928 00000100:00100000:3.0:1787759166.205195:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293404928 00010000:00010000:0.0:1787759166.205211:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.205215:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205226:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759166.205238:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205257:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166e200/0x662cc405a6abf4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4d3 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.205261:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787759166.205275:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759166.205275:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77485d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293404928:12345-0@lo:103: 00010000:00010000:0.0:1787759166.205278:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759166.205282:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759166.205288:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759166.205295:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205303:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.205343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759166.205398:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.205435:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405824:0@lo:104: 00010000:00010000:3.0:1787759166.205438:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.205456:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759166.205463:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.205490:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405824 00000100:00100000:3.0:1787759166.205492:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77485d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293404928:12345-0@lo:103: Request processed in 220us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.205495:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405824 00000100:00100000:0.0:1787759166.205516:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787759166.205522:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405824:12345-0@lo:104: 00010000:00010000:0.0:1787759166.205537:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.205572:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787759166.205577:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8429:x1874601293405824:12345-0@lo:104: Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.205584:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787759166.205601:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608840 going to sleep for 11 seconds 00000100:00100000:3.0:1787759166.205612:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787759166.205622:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7740030800/0x662cc405a6abf55f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf551 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.205636:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af043c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404416:0@lo:104: 00000100:00100000:0.0:1787759166.205649:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404672:0@lo:104: 00000100:00100000:3.0:1787759166.205657:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405440 00000100:00100000:0.0:1787759166.205661:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404800:0@lo:104: 00000100:00100000:3.0:1787759166.205663:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405440 00000100:00100000:0.0:1787759166.205671:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedf0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405056:0@lo:104: 00000100:00100000:0.0:1787759166.205683:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405568:0@lo:104: 00010000:00010000:3.0:1787759166.205685:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.205693:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293405824:0@lo:104: 00000100:00100000:1.0:1787759166.205744:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759166.205752:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293405696:0@lo:103: 00000100:00100000:3.0:1787759166.205772:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759166.205782:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3303:x1874601293405440:12345-0@lo:103: 00000100:00100000:1.0:1787759166.205791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759166.205795:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759166.205801:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.205810:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.205822:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf4f6 expref: 18 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.205831:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405184:0@lo:103: 00010000:00010000:3.0:1787759166.205832:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759166.205872:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:3303:x1874601293405440:12345-0@lo:103: Request processed in 92us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.205881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.205885:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759166.205901:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405696 00000100:00100000:1.0:1787759166.205904:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759166.205904:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405696 00000100:00100000:1.0:1787759166.205915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405312:0@lo:103: 00010000:00010000:3.0:1787759166.205921:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 17 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.205935:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405184 00000100:00100000:3.0:1787759166.205939:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405184 00000100:00100000:1.0:1787759166.205942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759166.205953:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.205969:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405312 00000100:00100000:3.0:1787759166.205971:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405312 00010000:00010000:3.0:1787759166.205990:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 19 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.205995:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dede580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293405440:0@lo:103: 00000100:00100000:3.0:1787759166.206009:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759166.206016:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293405696:12345-0@lo:103: 00010000:00010000:3.0:1787759166.206023:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759166.206028:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 19 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206035:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 19 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206044:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81600/0x662cc405a6abf4d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf4cc expref: 19 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206052:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759166.206101:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787759166.206109:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c732d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3305:x1874601293405184:12345-0@lo:103: 00010000:00010000:0.0:1787759166.206118:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759166.206123:0:5866:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.206134:0:5866:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.206142:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e40b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3303:x1874601293405696:12345-0@lo:103: Request processed in 124us (352us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759166.206150:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175600/0x662cc405a6abf519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf512 expref: 18 pid: 5829 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.206152:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787759166.206167:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787759166.206168:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759166.206198:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c732d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3305:x1874601293405184:12345-0@lo:103: Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.206240:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405184:0@lo:103: 00000100:00100000:1.0:1787759166.206271:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293405696:0@lo:103: 00000100:00100000:3.0:1787759166.206305:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3305:x1874601293405312:12345-0@lo:103: 00010000:00010000:3.0:1787759166.206314:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759166.206319:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 16 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206328:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 16 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206340:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf50b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf504 expref: 16 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.206360:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759166.206410:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787759166.206418:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af06580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:8429:x1874601293404544:12345-0@lo:104: Request processed in 2734us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.206426:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759166.206455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7321c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3305:x1874601293405312:12345-0@lo:103: Request processed in 152us (514us total) trans 0 rc 0/0 00010000:00010000:2.0:1787759166.206537:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787759166.206543:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206551:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a80a00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:2.0:1787759166.206555:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206563:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759166.206571:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759166.206577:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787759166.206610:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206617:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759166.206627:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206635:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a80a00/0x662cc405a6abf4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4a9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206644:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759166.206648:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206694:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740030e00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:2.0:1787759166.206698:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206705:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759166.206710:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759166.206715:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787759166.206786:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405952:0@lo:103: 00000100:00100000:1.0:1787759166.206826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.206849:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405312:0@lo:103: 00000100:00100000:1.0:1787759166.206901:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404544:0@lo:104: 00010000:00010000:2.0:1787759166.206934:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206942:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759166.206952:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206969:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740030e00/0x662cc405a6abf52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf535 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.206982:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759166.206984:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759166.206985:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759166.206997:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293405952 00000100:00100000:2.0:1787759166.207000:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293405952 00010000:00010000:2.0:1787759166.207015:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 16 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.207110:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759166.207118:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787759166.207164:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775afc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293404928:0@lo:103: 00000100:00100000:2.0:1787759166.207191:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787759166.207199:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c733840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:3305:x1874601293405952:12345-0@lo:103: 00010000:00010000:2.0:1787759166.207208:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759166.207213:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 14 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.207222:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 14 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.207233:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80400/0x662cc405a6abf4a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf4a2 expref: 14 pid: 5828 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.207243:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759166.207279:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c733840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3305:x1874601293405952:12345-0@lo:103: Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.207286:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787759166.207296:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759166.207322:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293406080:0@lo:103: 00000100:00100000:3.0:1787759166.207352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.207359:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293405952:0@lo:103: 00010000:00010000:3.0:1787759166.207408:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759166.207439:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406080 00000100:00100000:0.0:1787759166.207445:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406080 00010000:00010000:0.0:1787759166.207462:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 13 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.207484:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787759166.207491:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748445680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:3306:x1874601293406080:12345-0@lo:103: 00010000:00010000:0.0:1787759166.207499:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759166.207503:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 13 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.207512:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 13 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.207522:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81a00/0x662cc405a6abf535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf52e expref: 13 pid: 5830 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.207531:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759166.207563:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748445680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:3306:x1874601293406080:12345-0@lo:103: Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.207569:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759166.207592:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293406080:0@lo:103: 00000100:00100000:0.0:1787759166.210490:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af04780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404160:192.168.204.38@tcp:104: 00000100:00100000:0.0:1787759166.210504:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775af07480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874601293404288:192.168.204.38@tcp:104: 00010000:00010000:0.0:1787759166.210544:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.213672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759166.213713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759166.213776:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851520 00000100:00100000:0.0:1787759166.213784:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851520 00010000:00010000:0.0:1787759166.213820:0:5866:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 10 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.213855:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851392 00000100:00100000:0.0:1787759166.213858:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851392 00010000:00010000:0.0:1787759166.213869:0:5866:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 11 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.213900:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:0.0:1787759166.213910:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77485d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+11:2384:x1874601281851520:12345-192.168.204.38@tcp:103: 00010000:00010000:0.0:1787759166.213925:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759166.213931:0:5866:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 11 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.213941:0:5866:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 11 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.213970:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174000/0x662cc405a6abf56d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fd9 expref: 11 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.213986:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787759166.214022:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:1.0:1787759166.214034:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281851392:12345-192.168.204.38@tcp:103: 00010000:00010000:1.0:1787759166.214045:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787759166.214047:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77485d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281851520:12345-192.168.204.38@tcp:103: Request processed in 136us (382us total) trans 0 rc 0/0 00010000:00010000:1.0:1787759166.214054:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 10 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.214061:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00010000:00010000:1.0:1787759166.214072:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 10 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214086:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166ea00/0x662cc405a6abf574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7634fe0 expref: 9 pid: 5828 timeout: 230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214120:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214128:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214146:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214154:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214162:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214168:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214174:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77609e3a00 already unused, calling callback (ffffffffc144d530) 00010000:00010000:1.0:1787759166.214178:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214185:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214210:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.214220:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787759166.214260:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:2384:x1874601281851392:12345-192.168.204.38@tcp:103: Request processed in 229us (545us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759166.214272:0:8429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.214273:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:0.0:1787759166.214296:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.214304:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77609e3a00/0x662cc405a6abf5ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.452677:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759166.452743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851648 00000100:00100000:2.0:1787759166.452753:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851648 00000100:00100000:2.0:1787759166.452812:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:2.0:1787759166.452822:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:5616:x1874601281851648:12345-192.168.204.38@tcp:101: 00010000:00010000:2.0:1787759166.452838:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759166.452858:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a80c00/0x662cc405a6abf5b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7635042 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.452885:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a80c00/0x662cc405a6abf5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635042 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.452897:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a80c00/0x662cc405a6abf5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635042 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.452905:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80c00, rc 0) 00000100:00100000:2.0:1787759166.452970:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281851648:12345-192.168.204.38@tcp:101: Request processed in 149us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.452977:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 124 00000100:00100000:1.0:1787759166.456342:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759166.456509:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851776 00000100:00100000:2.0:1787759166.456517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851776 00000100:00100000:2.0:1787759166.456619:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:2.0:1787759166.456630:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281851776:12345-192.168.204.38@tcp:501: 00000100:00100000:2.0:1787759166.456941:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281851776:12345-192.168.204.38@tcp:501: Request processed in 312us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.456950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 125 00000100:00100000:3.0:1787759166.458976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759166.459391:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281851904 00000100:00100000:1.0:1787759166.459408:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281851904 00000100:00100000:1.0:1787759166.459453:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:1.0:1787759166.459463:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281851904:12345-192.168.204.38@tcp:503: 00000100:00100000:1.0:1787759166.459738:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281851904:12345-192.168.204.38@tcp:503: Request processed in 275us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.459747:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 126 00000100:00100000:1.0:1787759166.464189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759166.464302:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852032 00000100:00100000:2.0:1787759166.464311:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852032 00000100:00100000:2.0:1787759166.464403:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:2.0:1787759166.464419:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:6084:x1874601281852032:12345-192.168.204.38@tcp:502: 00000100:00100000:2.0:1787759166.465130:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:6084:x1874601281852032:12345-192.168.204.38@tcp:502: Request processed in 664us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.465141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 127 00000100:00100000:3.0:1787759166.472345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759166.472461:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852160 00000100:00100000:1.0:1787759166.472471:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852160 00000100:00100000:1.0:1787759166.472515:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:1.0:1787759166.472525:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:6084:x1874601281852160:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787759166.472815:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:6084:x1874601281852160:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 290us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.472824:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 128 00000100:00100000:3.0:1787759166.478486:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759166.478667:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852288 00000100:00100000:1.0:1787759166.478676:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852288 00000100:00100000:1.0:1787759166.478729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:1.0:1787759166.478747:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281852288:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759166.478764:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759166.478781:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782175800/0x662cc405a6abf5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7635049 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.478825:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175800/0x662cc405a6abf5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635049 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.478837:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782175800/0x662cc405a6abf5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635049 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.478847:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175800, rc 0) 00000100:00100000:1.0:1787759166.478900:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852288:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 163us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.478908:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 129 00000100:00100000:2.0:1787759166.481223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759166.481298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852416 00000100:00100000:0.0:1787759166.481306:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852416 00000100:00100000:0.0:1787759166.481347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:0.0:1787759166.481356:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852416:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.481656:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852416:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 299us (437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787759166.481665:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00010000:00010000:2.0:1787759166.607922:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787759166.638445:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787759166.638452:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7641cc9000 from 39 10000000:01000000:1.0:1787759166.638457:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787759166.638506:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.638518:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.638529:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.638550:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406208:0@lo:101: 00000100:00100000:1.0:1787759166.638615:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.638672:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.641143:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406208 00000100:00100000:2.0:1787759166.641154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406208 00000100:00100000:2.0:1787759166.641219:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787759166.641229:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+12:5832:x1874601293406208:12345-0@lo:101: 00010000:00010000:2.0:1787759166.641254:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759166.641272:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a80000/0x662cc405a6abf5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf5c1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.641298:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a80000/0x662cc405a6abf5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf5c1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.641309:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a80000/0x662cc405a6abf5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf5c1 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.641317:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80000, rc 0) 00000100:00100000:2.0:1787759166.641413:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406208:12345-0@lo:101: Request processed in 185us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.641421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787759166.641451:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406208:0@lo:101: 00010000:00010000:3.0:1787759166.641470:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.641480:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.641542:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406336:0@lo:501: 00000100:00100000:3.0:1787759166.641573:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.641596:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.641656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406336 00000100:00100000:0.0:1787759166.641660:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406336 00000100:00100000:0.0:1787759166.641695:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787759166.641702:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406336:12345-0@lo:501: 00000100:00100000:0.0:1787759166.641945:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406336:12345-0@lo:501: Request processed in 243us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.641952:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787759166.642218:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406336:0@lo:501: 00000100:00100000:3.0:1787759166.642257:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406464:0@lo:503: 00000100:00100000:3.0:1787759166.642298:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.642322:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.642362:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406464 00000100:00100000:1.0:1787759166.642390:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406464 00000100:00100000:1.0:1787759166.642430:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787759166.642452:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406464:12345-0@lo:503: 00000100:00100000:1.0:1787759166.642598:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406464:12345-0@lo:503: Request processed in 149us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.642606:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787759166.642626:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406464:0@lo:503: 00000100:00100000:0.0:1787759166.643022:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8445:1874601293406592:0@lo:502: 00000100:00100000:0.0:1787759166.643056:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.643116:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608000 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.643151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406592 00000100:00100000:2.0:1787759166.643160:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406592 00000100:00100000:2.0:1787759166.643189:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787759166.643195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:8445:x1874601293406592:12345-0@lo:502: 00000100:00100000:2.0:1787759166.643483:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:8445:x1874601293406592:12345-0@lo:502: Request processed in 287us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.643490:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787759166.643611:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8445:1874601293406592:0@lo:502: 00000100:00100000:0.0:1787759166.643645:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8445:1874601293406720:0@lo:502: 00000100:00100000:0.0:1787759166.643678:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.643735:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608000 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.643769:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406720 00000100:00100000:2.0:1787759166.643772:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406720 00000100:00100000:2.0:1787759166.643830:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787759166.643837:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:8445:x1874601293406720:12345-0@lo:502: 00000100:00100000:2.0:1787759166.643960:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:8445:x1874601293406720:12345-0@lo:502: Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.643967:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787759166.644025:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8445:1874601293406720:0@lo:502: 00000040:00080000:0.0:1787759166.644042:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787759166.644175:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787759166.644191:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787759166.644199:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.644207:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759166.644215:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787759166.644218:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787759166.644220:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787759166.644251:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.644258:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.644266:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.644278:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406848:0@lo:101: 00000100:00100000:3.0:1787759166.644306:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.644525:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.644584:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406848 00000100:00100000:1.0:1787759166.644588:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406848 00000100:00100000:2.0:1787759166.644621:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787759166.644628:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+13:5832:x1874601293406848:12345-0@lo:101: 00010000:00010000:2.0:1787759166.644636:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759166.644645:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81800/0x662cc405a6abf5d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf5cf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.644664:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81800/0x662cc405a6abf5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf5cf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.644673:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81800/0x662cc405a6abf5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf5cf expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.644681:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81800, rc 0) 00000100:00100000:2.0:1787759166.644716:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293406848:12345-0@lo:101: Request processed in 89us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.644731:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787759166.644780:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406848:0@lo:101: 00010000:00010000:3.0:1787759166.644791:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.644805:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759166.644838:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406976:0@lo:501: 00000100:00100000:3.0:1787759166.644860:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.644963:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.645002:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293406976 00000100:00100000:0.0:1787759166.645006:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293406976 00000100:00100000:0.0:1787759166.645024:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787759166.645029:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293406976:12345-0@lo:501: 00000100:00100000:0.0:1787759166.645207:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293406976:12345-0@lo:501: Request processed in 176us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.645214:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787759166.645276:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293406976:0@lo:501: 00000100:00100000:3.0:1787759166.645299:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407104:0@lo:503: 00000100:00100000:3.0:1787759166.645330:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.645352:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.645426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407104 00000100:00100000:0.0:1787759166.645431:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407104 00000100:00100000:0.0:1787759166.645447:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787759166.645452:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293407104:12345-0@lo:503: 00000100:00100000:0.0:1787759166.645572:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293407104:12345-0@lo:503: Request processed in 119us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.645579:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787759166.645677:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407104:0@lo:503: 00000100:00100000:3.0:1787759166.645929:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8446:1874601293407232:0@lo:502: 00000100:00100000:3.0:1787759166.645960:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.645984:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.646018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407232 00000100:00100000:0.0:1787759166.646021:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407232 00000100:00100000:0.0:1787759166.646037:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787759166.646042:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8446:x1874601293407232:12345-0@lo:502: 00000100:00100000:0.0:1787759166.646182:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8446:x1874601293407232:12345-0@lo:502: Request processed in 139us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.646189:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787759166.646453:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8446:1874601293407232:0@lo:502: 00000020:01000000:3.0:1787759166.646474:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787759166.646481:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759166.646484:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787759166.646489:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787759166.646507:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8446:1874601293407360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759166.646536:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759166.646628:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d776007b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.646661:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407360 00000100:00100000:0.0:1787759166.646665:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407360 00000100:00100000:0.0:1787759166.646728:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787759166.646734:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8446:x1874601293407360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.646841:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:8446:x1874601293407360:12345-0@lo:502:llog_process_th.0 Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.646847:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787759166.646907:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8446:1874601293407360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787759166.646924:0:8446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759166.646933:0:8446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759166.646934:0:8446:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787759166.646938:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787759166.647057:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787759166.647072:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787759166.647079:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.647087:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759166.647095:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787759166.647097:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7773d06800 from 39 10000000:01000000:2.0:1787759166.647100:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787759166.647117:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.647124:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.647132:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.647143:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.647168:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.647229:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774391b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.647294:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407488 00000100:00100000:1.0:1787759166.647299:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407488 00000100:00100000:1.0:1787759166.647319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787759166.647324:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:5832:x1874601293407488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759166.647332:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759166.647342:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf5dd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.647358:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf5dd expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.647395:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf5dd expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.647404:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174c00, rc 0) 00000100:00100000:1.0:1787759166.647430:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293407488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.647436:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787759166.647499:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759166.647510:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.647518:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.647622:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.647647:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.647671:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774391b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.647717:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407616 00000100:00100000:1.0:1787759166.647722:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407616 00000100:00100000:1.0:1787759166.647737:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787759166.647742:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293407616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.647919:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293407616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.647927:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787759166.647992:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.648016:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.648048:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.648069:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774391b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.648114:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407744 00000100:00100000:1.0:1787759166.648118:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407744 00000100:00100000:1.0:1787759166.648133:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787759166.648138:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293407744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.648258:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293407744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.648265:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787759166.648333:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293407744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.648984:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8447:1874601293407872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.649020:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.649084:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608300 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.649116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293407872 00000100:00100000:1.0:1787759166.649120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293407872 00000100:00100000:1.0:1787759166.649178:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787759166.649186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8447:x1874601293407872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.649352:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8447:x1874601293407872:12345-0@lo:502:llog_process_th.0 Request processed in 167us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.649360:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787759166.649452:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8447:1874601293407872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759166.649486:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8447:1874601293408000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759166.649514:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.649809:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774391b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.649879:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408000 00000100:00100000:0.0:1787759166.649883:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408000 00000100:00100000:0.0:1787759166.649902:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787759166.649908:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8447:x1874601293408000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.650038:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:8447:x1874601293408000:12345-0@lo:502:llog_process_th.0 Request processed in 129us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.650044:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787759166.650112:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8447:1874601293408000:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787759166.650131:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787759166.650258:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787759166.650276:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787759166.650284:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.650293:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759166.650302:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787759166.650304:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787759166.650307:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787759166.650326:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.650340:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.650348:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.650361:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.650419:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.650435:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77516089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.650484:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408128 00000100:00100000:2.0:1787759166.650489:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408128 00000100:00100000:2.0:1787759166.650505:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787759166.650510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:5832:x1874601293408128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759166.650518:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759166.650527:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81c00/0x662cc405a6abf5f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf5eb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.650605:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81c00/0x662cc405a6abf5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf5eb expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.650621:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81c00/0x662cc405a6abf5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf5eb expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.650629:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81c00, rc 0) 00000100:00100000:2.0:1787759166.650666:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.650671:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787759166.650767:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759166.650779:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.650787:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.650821:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.650845:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.650864:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77516089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.650899:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408256 00000100:00100000:2.0:1787759166.650903:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408256 00000100:00100000:2.0:1787759166.650929:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787759166.650934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.651112:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.651120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787759166.651206:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.651229:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.651272:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.651292:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77516089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.651330:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408384 00000100:00100000:2.0:1787759166.651334:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408384 00000100:00100000:2.0:1787759166.651361:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787759166.651393:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.651512:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.651519:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787759166.651739:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.652019:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8448:1874601293408512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.652054:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.652080:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608240 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.652116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408512 00000100:00100000:1.0:1787759166.652120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408512 00000100:00100000:1.0:1787759166.652139:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787759166.652145:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8448:x1874601293408512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.652276:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8448:x1874601293408512:12345-0@lo:502:llog_process_th.0 Request processed in 131us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.652283:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787759166.652396:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8448:1874601293408512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759166.652417:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759166.652425:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759166.652427:0:8448:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787759166.652432:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787759166.652450:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8448:1874601293408640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.652479:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.652493:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608240 going to sleep for 11 seconds 00000100:00100000:1.0:1787759166.652602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408640 00000100:00100000:1.0:1787759166.652606:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408640 00000100:00100000:1.0:1787759166.652632:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787759166.652637:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8448:x1874601293408640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.652735:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:8448:x1874601293408640:12345-0@lo:502:llog_process_th.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759166.652742:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787759166.652851:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8448:1874601293408640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759166.652867:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759166.652871:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759166.652873:0:8448:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787759166.652877:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787759166.653043:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787759166.653058:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787759166.653066:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.653074:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759166.653083:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787759166.653085:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d7758776000 from 39 10000000:01000000:1.0:1787759166.653087:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787759166.653105:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.653112:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.653119:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.653131:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.653156:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.653205:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77586adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.653280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408768 00000100:00100000:2.0:1787759166.653284:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408768 00000100:00100000:2.0:1787759166.653344:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787759166.653351:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293408768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759166.653360:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759166.653404:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a80a00/0x662cc405a6abf600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf5f9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.653421:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a80a00/0x662cc405a6abf600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf5f9 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.653430:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a80a00/0x662cc405a6abf600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf5f9 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.653437:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80a00, rc 0) 00000100:00100000:2.0:1787759166.653514:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293408768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.653520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787759166.653692:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759166.653708:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759166.653717:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759166.653753:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.653776:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.653829:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77586adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.653862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293408896 00000100:00100000:2.0:1787759166.653866:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293408896 00000100:00100000:2.0:1787759166.653921:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787759166.653928:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293408896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.654102:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293408896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759166.654109:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787759166.654164:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293408896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.654188:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.654223:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.654315:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77586adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.654347:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409024 00000100:00100000:0.0:1787759166.654350:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409024 00000100:00100000:0.0:1787759166.654403:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787759166.654409:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293409024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.654522:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293409024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.654529:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787759166.654615:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759166.654921:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8449:1874601293409152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.654952:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.654977:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750ba1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.655022:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409152 00000100:00100000:0.0:1787759166.655026:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409152 00000100:00100000:0.0:1787759166.655044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787759166.655049:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8449:x1874601293409152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.655188:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8449:x1874601293409152:12345-0@lo:502:llog_process_th.0 Request processed in 138us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.655201:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787759166.655276:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8449:1874601293409152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.655311:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8449:1874601293409280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759166.655341:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759166.655360:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77586adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.655441:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409280 00000100:00100000:0.0:1787759166.655445:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409280 00000100:00100000:0.0:1787759166.655462:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787759166.655468:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8449:x1874601293409280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.655702:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8449:x1874601293409280:12345-0@lo:502:llog_process_th.0 Request processed in 233us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.655709:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787759166.656282:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8449:1874601293409280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787759166.656303:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787759166.656494:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787759166.656509:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787759166.656517:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.656527:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759166.656536:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787759166.656631:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787759166.656634:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787759166.656657:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.656664:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.656671:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.656684:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.656714:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.656744:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7748366d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759166.656827:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409408 00000100:00100000:3.0:1787759166.656832:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409408 00000100:00100000:3.0:1787759166.656865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787759166.656872:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293409408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759166.656879:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759166.656890:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166f800/0x662cc405a6abf60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf607 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.656910:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166f800/0x662cc405a6abf60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf607 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.656919:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166f800/0x662cc405a6abf60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf607 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.656928:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166f800, rc 0) 00000100:00100000:3.0:1787759166.656958:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293409408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.656970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787759166.659616:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759166.659637:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759166.659649:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759166.659711:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.659754:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.659791:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7748366d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759166.659849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409536 00000100:00100000:3.0:1787759166.659855:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409536 00000100:00100000:3.0:1787759166.659922:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787759166.659930:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293409536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759166.660154:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293409536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.660162:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787759166.660187:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.660217:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.660267:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.660917:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7748366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.660998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409664 00000100:00100000:0.0:1787759166.661003:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409664 00000100:00100000:3.0:1787759166.661099:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787759166.661113:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293409664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759166.661263:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293409664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.661270:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787759166.662009:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293409664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.662718:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8450:1874601293409792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759166.662765:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.662833:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7748366d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759166.663461:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409792 00000100:00100000:3.0:1787759166.663467:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409792 00000100:00100000:3.0:1787759166.663516:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787759166.663523:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8450:x1874601293409792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759166.665327:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8450:x1874601293409792:12345-0@lo:502:llog_process_th.0 Request processed in 1799us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.665338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787759166.665523:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8450:1874601293409792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759166.665556:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759166.665564:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759166.665567:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787759166.665573:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787759166.665614:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8450:1874601293409920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759166.665654:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759166.665687:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7758ed66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787759166.666506:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293409920 00000100:00100000:0.0:1787759166.666513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293409920 00000100:00100000:0.0:1787759166.666550:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787759166.666559:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8450:x1874601293409920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759166.666824:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8450:x1874601293409920:12345-0@lo:502:llog_process_th.0 Request processed in 265us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759166.666831:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787759166.668062:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8450:1874601293409920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787759166.668104:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787759166.668112:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787759166.668114:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787759166.668119:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787759166.668274:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787759166.668297:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787759166.668308:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.668319:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759166.668329:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787759166.668332:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d7746458000 from 1 10000000:01000000:0.0:1787759166.668342:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787759166.668408:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.668417:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.668427:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.668444:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293410048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.668483:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.668518:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787759166.668563:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410048 00000100:00100000:3.0:1787759166.668568:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410048 00000100:00100000:3.0:1787759166.668607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787759166.668615:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293410048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759166.668626:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759166.668638:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166fc00/0x662cc405a6abf61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf615 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.668660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166fc00/0x662cc405a6abf61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf615 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.668682:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166fc00/0x662cc405a6abf61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf615 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.668691:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166fc00, rc 0) 00000100:00100000:3.0:1787759166.668730:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293410048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759166.668737:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787759166.669007:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293410048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759166.669021:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf61c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759166.669030:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf61c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759166.669091:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293410176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759166.669121:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759166.669183:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7751608a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759166.670321:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410176 00000100:00100000:2.0:1787759166.670331:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410176 00000100:00100000:2.0:1787759166.670404:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787759166.670413:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293410176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759166.671467:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293410176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1050us (2340us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787759166.671477:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787759166.674302:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293410176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787759166.674640:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787759166.674652:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf61c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759166.674943:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d77609e3e00/0x662cc405a6abf615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf61c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.632125:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787759167.829022:0:8488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd200c72a0 20000000:00000080:1.0:1787759167.829045:0:8488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d777c734000 uarg=0000000000000000 20000000:01000000:1.0:1787759167.829082:0:8488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787759167.829087:0:8488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787759167.829092:0:8488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787759167.830987:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787759167.831162:0:8488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787759167.835427:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787759167.835499:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787759167.835552:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787759167.835571:0:8488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787759167.835597:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835619:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835629:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf463 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835637:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf4be expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835647:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835656:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835702:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835720:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 9 pid: 5830 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.835766:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410304:192.168.204.38@tcp:104: 00010000:00010000:1.0:1787759167.835896:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.835906:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 18 pid: 5828 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.835916:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410432:0@lo:104: 00000100:00100000:1.0:1787759167.835964:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759167.836012:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.836021:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410432 00010000:00010000:1.0:1787759167.836022:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 18 pid: 5830 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.836035:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410432 00000100:00100000:1.0:1787759167.836041:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c733480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410560:0@lo:104: 00000100:00100000:1.0:1787759167.836076:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759167.836108:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.836115:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410560 00010000:00010000:1.0:1787759167.836118:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 18 pid: 5829 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.836122:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410560 00000100:00100000:1.0:1787759167.836134:0:8488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410688:0@lo:104: 00000100:00100000:0.0:1787759167.836150:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759167.836172:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8488:x1874601293410432:12345-0@lo:104: 00000100:00100000:1.0:1787759167.836174:0:8488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.836188:0:8488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750ba1600 going to sleep for 11 seconds 00010000:00010000:0.0:1787759167.836206:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.836256:0:6314:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787759167.836268:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410688 00000100:00100000:3.0:1787759167.836272:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410688 00000100:00100000:3.0:1787759167.836292:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787759167.836298:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8488:x1874601293410560:12345-0@lo:104: 00010000:00010000:3.0:1787759167.836307:0:6314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836308:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787759167.836313:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c730000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:8488:x1874601293410432:12345-0@lo:104: Request processed in 153us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.836320:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759167.836336:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787759167.836340:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787759167.836342:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748440450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8488:x1874601293410688:12345-0@lo:104: 00000100:00100000:3.0:1787759167.836345:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:8488:x1874601293410560:12345-0@lo:104: Request processed in 47us (270us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759167.836349:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.836358:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787759167.836401:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787759167.836406:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748440450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+3:8488:x1874601293410688:12345-0@lo:104: Request processed in 65us (242us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759167.836410:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787759167.836412:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787759167.836416:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836422:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ee00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759167.836426:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836434:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759167.836441:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836445:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:3.0:1787759167.836447:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759167.836448:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836454:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740031c00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759167.836456:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836462:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759167.836468:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759167.836477:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787759167.836478:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836483:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759167.836489:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836493:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759167.836502:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836502:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836511:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740031c00/0x662cc405a6abf463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf46a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836511:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf4be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf4c5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836524:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759167.836527:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.836534:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759167.836535:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759167.836537:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759167.836542:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7740031200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759167.836545:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836551:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759167.836557:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.836560:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293410816:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1787759167.836562:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787759167.836574:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836580:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787759167.836591:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759167.836593:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836600:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7740031200/0x662cc405a6abf3e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf3ec expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.836612:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759167.836613:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759167.836615:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759167.836624:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759167.836637:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410816 00000100:00100000:0.0:1787759167.836640:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410816 00000100:00100000:3.0:1787759167.836646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787759167.836658:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 19 pid: 5828 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.836669:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759167.836676:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293411072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759167.836688:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293410944 00000100:00100000:0.0:1787759167.836691:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293410944 00010000:00010000:0.0:1787759167.836701:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 20 pid: 5830 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.836705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787759167.836808:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759167.837287:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411072 00000100:00100000:0.0:1787759167.837291:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411072 00010000:00010000:0.0:1787759167.837306:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 21 pid: 5829 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759167.837331:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787759167.837337:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+21:3303:x1874601293410816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759167.837346:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759167.837351:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 21 pid: 5828 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.837360:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 21 pid: 5828 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.837392:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759167.837427:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+21:3303:x1874601293410816:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.837434:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787759167.837450:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787759167.837457:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3304:x1874601293410944:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759167.837461:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787759167.837468:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787759167.837475:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77484443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3306:x1874601293411072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759167.837476:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 20 pid: 5830 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.837490:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759167.837491:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 20 pid: 5830 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.837497:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 20 pid: 5829 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.837505:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759167.837520:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 20 pid: 5829 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.837545:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759167.837611:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293411072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759167.837739:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77484443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3306:x1874601293411072:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.837754:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787759167.838129:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7740031400/0x662cc405a6abf4c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf4be expref: 19 pid: 5828 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.838250:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410432:0@lo:104: 00010000:00010000:1.0:1787759167.838267:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7740030400/0x662cc405a6abf46a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf463 expref: 18 pid: 5830 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.838278:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c733480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410560:0@lo:104: 00010000:00010000:1.0:1787759167.838288:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175200/0x662cc405a6abf3ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf3e5 expref: 17 pid: 5829 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.838297:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410688:0@lo:104: 00000100:00100000:0.0:1787759167.839103:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3304:x1874601293410944:12345-0@lo:103:ldlm_bl.0 Request processed in 1643us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.839112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759167.839171:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759167.839181:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293410816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759167.839958:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759167.840019:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852544 00000100:00100000:3.0:1787759167.840027:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852544 00000100:00100000:1.0:1787759167.840042:0:8488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1874601293410304:192.168.204.38@tcp:104: 00010000:00010000:3.0:1787759167.840068:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.840137:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:3.0:1787759167.840148:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2383:x1874601281852544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787759167.840164:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759167.840175:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840189:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.840203:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840210:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81e00/0x662cc405a6abf582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635011 expref: 10 pid: 5830 timeout: 232 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840241:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840251:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840267:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840289:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840297:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840304:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840311:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782174e00 already unused, calling callback (ffffffffc144d530) 00010000:00010000:3.0:1787759167.840316:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840325:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840346:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.840356:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759167.840447:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:2383:x1874601281852544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 301us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759167.840455:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00010000:00010000:1.0:1787759167.840531:0:8488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.840539:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.840547:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf623 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759167.970201:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787759167.970207:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7641cc9000 from 4 10000000:01000000:3.0:1787759167.970222:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759167.970322:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.970335:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.970357:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.970443:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.971132:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759167.971200:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7773f6d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.972119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411200 00000100:00100000:2.0:1787759167.972131:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411200 00000100:00100000:2.0:1787759167.972199:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787759167.972222:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293411200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759167.972239:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759167.972256:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf62a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.972506:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.972519:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.972529:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81200, rc 0) 00000100:00100000:2.0:1787759167.972589:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 381us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.972596:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787759167.973023:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759167.973060:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.973070:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.973147:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.973184:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759167.973235:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7773f6d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787759167.974145:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411328 00000100:00100000:0.0:1787759167.974151:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411328 00000100:00100000:0.0:1787759167.974246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787759167.974669:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787759167.974951:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.974959:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787759167.975075:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.975118:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.975162:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.975185:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750ba1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.976044:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411456 00000100:00100000:2.0:1787759167.976051:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411456 00000100:00100000:2.0:1787759167.976105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787759167.976113:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759167.976827:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77721bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 713us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.976835:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787759167.976913:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.977472:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8501:1874601293411584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759167.977518:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.977548:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7750ba1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787759167.977795:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411584 00000100:00100000:0.0:1787759167.977801:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411584 00000100:00100000:0.0:1787759167.977882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787759167.977901:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8501:x1874601293411584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759167.978070:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8501:x1874601293411584:12345-0@lo:502:llog_process_th.0 Request processed in 170us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.978079:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787759167.978099:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8501:1874601293411584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759167.978126:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787759167.978137:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759167.978139:0:8501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787759167.978145:0:8501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7641cc9000 00000020:00000080:2.0:1787759167.978147:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787759167.978337:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8501:1874601293411712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759167.978393:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759167.978412:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77721a63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787759167.978682:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411712 00000100:00100000:3.0:1787759167.978688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411712 00000100:00100000:3.0:1787759167.978727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787759167.978736:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8501:x1874601293411712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787759167.978903:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:8501:x1874601293411712:12345-0@lo:502:llog_process_th.0 Request processed in 168us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759167.978911:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787759167.978937:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8501:1874601293411712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787759167.978964:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787759167.978970:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787759167.978971:0:8501:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787759167.978974:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787759167.979207:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787759167.979242:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759167.979253:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.979272:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759167.979284:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787759167.979287:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7773d06800 from 4 10000000:01000000:3.0:1787759167.979291:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759167.979318:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.979326:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.979335:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.979351:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.979412:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759167.979448:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411840 00000100:00100000:3.0:1787759167.979450:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7773f6dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787759167.979454:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411840 00000100:00100000:0.0:1787759167.979485:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787759167.979492:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293411840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759167.979501:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759167.979513:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf638 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.979534:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf638 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.979544:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf638 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759167.979563:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77609e2a00, rc 0) 00000100:00100000:0.0:1787759167.979646:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293411840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.979654:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787759167.981426:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759167.981454:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759167.981468:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759167.981554:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.981604:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759167.981660:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7773f6dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.982343:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293411968 00000100:00100000:2.0:1787759167.982352:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293411968 00000100:00100000:2.0:1787759167.982428:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787759167.982438:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293411968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759167.982740:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293411968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.982748:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787759167.983302:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293411968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.983342:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759167.983401:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759167.983431:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7773f6dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.983685:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412096 00000100:00100000:2.0:1787759167.983696:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412096 00000100:00100000:2.0:1787759167.983738:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787759167.983746:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293412096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759167.983912:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293412096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.983921:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787759167.983937:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787759167.984898:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776deded00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8504:1874601293412224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759167.984944:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759167.984971:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774853a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759167.985059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412224 00000100:00100000:1.0:1787759167.985064:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412224 00000100:00100000:1.0:1787759167.985095:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787759167.985102:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8504:x1874601293412224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759167.985266:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8504:x1874601293412224:12345-0@lo:502:llog_process_th.0 Request processed in 164us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759167.985274:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787759167.985343:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776deded00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8504:1874601293412224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759167.985393:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787759167.985403:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759167.985405:0:8504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787759167.985415:0:8504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7773d06800 00000020:00000080:0.0:1787759167.985418:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787759167.985490:0:8504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776deded00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8504:1874601293412352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759167.985520:0:8504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759167.986003:0:8504:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d774853a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.986075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412352 00000100:00100000:2.0:1787759167.986080:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412352 00000100:00100000:2.0:1787759167.986147:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787759167.986155:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8504:x1874601293412352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759167.986308:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7742f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:8504:x1874601293412352:12345-0@lo:502:llog_process_th.0 Request processed in 154us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.986316:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787759167.986394:0:8504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776deded00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8504:1874601293412352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787759167.986417:0:8504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787759167.986422:0:8504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787759167.986424:0:8504:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787759167.986428:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787759167.986604:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787759167.986622:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787759167.986631:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986641:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759167.986651:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787759167.986653:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7758776000 from 4 10000000:01000000:1.0:1787759167.986667:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787759167.986692:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986699:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986717:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.986731:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.986760:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.986781:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787759167.986792:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412480 00000100:00100000:1.0:1787759167.986795:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412480 00000100:00100000:1.0:1787759167.986815:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787759167.986820:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293412480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759167.986828:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759167.986839:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf646 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986858:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf646 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986869:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf646 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986876:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175200, rc 0) 00000100:00100000:1.0:1787759167.986900:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293412480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759167.986905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787759167.986930:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759167.986940:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759167.986955:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759167.987114:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.987136:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.987149:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787759167.987160:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412608 00000100:00100000:1.0:1787759167.987162:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412608 00000100:00100000:1.0:1787759167.987180:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787759167.987186:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293412608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.987408:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775b8c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293412608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759167.987414:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787759167.987442:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.987466:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.987497:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.987515:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787759167.987525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412736 00000100:00100000:1.0:1787759167.987528:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412736 00000100:00100000:1.0:1787759167.987548:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787759167.987553:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293412736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.990876:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293412736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3313us (3369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759167.990890:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787759167.990970:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293412736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759167.991843:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8505:1874601293412864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759167.991902:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759167.992504:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412864 00000100:00100000:0.0:1787759167.992511:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412864 00000100:00100000:0.0:1787759167.992690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787759167.992700:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:8505:x1874601293412864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787759167.993079:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:8505:x1874601293412864:12345-0@lo:502:llog_process_th.0 Request processed in 380us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759167.993089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787759167.993490:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787759167.993513:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8505:1874601293412864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759167.993542:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787759167.993552:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759167.993555:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787759167.993561:0:8505:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d7758776000 00000020:00000080:1.0:1787759167.993564:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787759167.993627:0:8505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8505:1874601293412992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787759167.993771:0:8505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759167.993799:0:8505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787759167.994959:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293412992 00000100:00100000:2.0:1787759167.994967:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293412992 00000100:00100000:2.0:1787759167.995016:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787759167.995025:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:8505:x1874601293412992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787759167.995264:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:8505:x1874601293412992:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759167.995272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787759167.995335:0:8505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:8505:1874601293412992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787759167.995361:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787759167.995425:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787759167.995428:0:8505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787759167.995433:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787759167.995595:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787759167.995614:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759167.995623:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759167.995634:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759168.335383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759168.335404:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293413120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759168.336565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759168.336628:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413120 00000100:00100000:2.0:1787759168.336634:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413120 00000100:00100000:2.0:1787759168.336686:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787759168.336695:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293413120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759168.336732:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759168.336776:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293413120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759168.336783:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787759168.336803:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787759168.336831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d775aea1680 x1874601293413120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759168.336851:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d775aea1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293413120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759168.443425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759168.444108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852672 00000100:00100000:0.0:1787759168.444126:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852672 00000100:00100000:0.0:1787759168.444230:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:0.0:1787759168.444246:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281852672:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787759168.444300:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759168.444323:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7635050 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759168.444358:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759168.444410:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759168.444420:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77609e2c00, rc 0) 00000100:00100000:0.0:1787759168.444514:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852672:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 268us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759168.444524:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 178 00000100:00100000:1.0:1787759168.447425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759168.447484:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852800 00000100:00100000:2.0:1787759168.447497:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852800 00000100:00100000:2.0:1787759168.447673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:2.0:1787759168.447685:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852800:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759168.448048:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852800:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 365us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759168.448060:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 179 00000100:00100000:1.0:1787759168.452275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759168.452542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281852928 00000100:00100000:3.0:1787759168.452555:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281852928 00000100:00100000:3.0:1787759168.452632:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:3.0:1787759168.452647:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852928:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759168.453221:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281852928:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 576us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759168.453233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 180 00000100:00100000:0.0:1787759168.458170:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759168.458282:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853056 00000100:00100000:2.0:1787759168.458293:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853056 00000100:00100000:2.0:1787759168.458361:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:2.0:1787759168.458435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:6142:x1874601281853056:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787759168.458919:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:6142:x1874601281853056:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 435us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759168.458927:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 181 00000100:00100000:1.0:1787759168.461988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759168.462060:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853184 00000100:00100000:3.0:1787759168.462069:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853184 00000100:00100000:3.0:1787759168.462120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 182 00000100:00100000:3.0:1787759168.462130:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:6142:x1874601281853184:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787759168.462427:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:6142:x1874601281853184:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 297us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759168.462437:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 182 00010000:00010000:0.0:1787759168.654473:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759168.846525:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293413248:0@lo:400:kworker.0 00000100:00100000:0.0:1787759168.846607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759168.846681:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413248 00000100:00100000:0.0:1787759168.846688:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413248 00000100:00100000:1.0:1787759168.846954:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293413504:0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.846986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759168.847010:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759168.847016:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c733c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293413632:0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759168.847073:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413504 00000100:00100000:1.0:1787759168.847077:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413504 00000100:00100000:1.0:1787759168.847118:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787759168.847127:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293413504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847178:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293413504:12345-0@lo:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759168.847186:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787759168.847223:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413632 00000100:00100000:1.0:1787759168.847226:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413632 00000100:00100000:1.0:1787759168.847249:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787759168.847255:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293413632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847284:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293413632:12345-0@lo:400:kworker.0 Request processed in 29us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759168.847290:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787759168.847305:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787759168.847332:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d777c733c00 x1874601293413632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759168.847345:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c733c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293413632:0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847356:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293413504:0@lo:400:kworker.0 00000100:00100000:2.0:1787759168.847482:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c730f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293413760:0@lo:400:kworker.0 00000100:00100000:2.0:1787759168.847513:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759168.847531:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787759168.847536:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293413376:0@lo:400:kworker.0 00000100:00100000:2.0:1787759168.847561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759168.847576:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d777c7330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293413888:0@lo:400:kworker.0 00000100:00100000:2.0:1787759168.847595:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759168.847650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413760 00000100:00100000:1.0:1787759168.847654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413760 00000100:00100000:1.0:1787759168.847690:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413376 00000100:00100000:1.0:1787759168.847694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413376 00000100:00100000:1.0:1787759168.847710:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787759168.847716:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293413760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847823:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e40b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293413760:12345-0@lo:400:kworker.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759168.847839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787759168.847852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787759168.847858:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293413376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e42940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293413376:12345-0@lo:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759168.847894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787759168.847940:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293413376:0@lo:400:kworker.0 00000100:00100000:1.0:1787759168.847948:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293413760:0@lo:400:kworker.0 00000100:00080000:2.0:1787759168.847990:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759168.848190:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787759168.848209:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293413248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759168.848258:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293413248:12345-0@lo:400:kworker.0 Request processed in 52us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759168.848265:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787759168.848305:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293413888 00000100:00100000:0.0:1787759168.848309:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293413888 00000100:00100000:0.0:1787759168.848339:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787759168.848345:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293413888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759168.848391:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7752e421c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293413888:12345-0@lo:400:kworker.0 Request processed in 46us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759168.848398:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787759168.848412:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787759168.848576:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d777c7330c0 x1874601293413888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759168.848589:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c7330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293413888:0@lo:400:kworker.0 00000100:00100000:2.0:1787759168.848601:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d777c730780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293413248:0@lo:400:kworker.0 00000100:00100000:0.0:1787759169.359568:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787759169.359592:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748447c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293414016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759169.359665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759169.359781:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414016 00000100:00100000:2.0:1787759169.359788:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414016 00000100:00100000:2.0:1787759169.359836:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787759169.359845:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293414016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787759169.359875:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759169.359925:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293414016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759169.359948:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787759169.360061:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748447c00 x1874601293414016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759169.360077:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748447c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293414016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787759169.679460:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759170.703550:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759170.877658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759170.877705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759170.877728:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759170.877742:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853568 00000100:00100000:3.0:1787759170.877752:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853568 00000100:00100000:2.0:1787759170.877753:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853312 00000100:00100000:1.0:1787759170.877759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759170.877759:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853312 00000100:00100000:1.0:1787759170.877794:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853440 00000100:00100000:1.0:1787759170.877800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853440 00000100:00100000:3.0:1787759170.877811:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853696 00000100:00100000:2.0:1787759170.877817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:3.0:1787759170.877817:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853696 00000100:00100000:1.0:1787759170.877841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1787759170.877853:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1787759170.877855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:2384:x1874601281853440:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1787759170.877864:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c733c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281853568:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759170.877883:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281853312:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1787759170.877926:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c733c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281853568:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 64us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759170.877928:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:2384:x1874601281853440:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 76us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759170.877933:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281853312:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759170.877943:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 8 00000100:00100000:1.0:1787759170.877946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:2.0:1787759170.877952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 184 00000100:00100000:3.0:1787759170.877968:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00100000:1.0:1787759170.877976:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787759170.877980:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c730b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281853696:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759170.877985:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787759170.878012:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c730b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+5:2384:x1874601281853696:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759170.878018:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9 00000100:00080000:3.0:1787759170.878037:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759170.878042:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759170.878044:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787759170.946853:0:8787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787759171.727608:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759172.751482:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759173.185641:0:9030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing yml_node 00000100:00100000:2.0:1787759173.455692:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787759173.455709:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293414144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759173.455766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759173.455817:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414144 00000100:00100000:2.0:1787759173.455822:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414144 00000100:00100000:2.0:1787759173.455883:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787759173.455892:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293414144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787759173.455928:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787759173.455985:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293414144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759173.455993:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787759173.456014:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787759173.456079:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776dc4cb40 x1874601293414144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759173.456098:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293414144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759173.775530:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759173.968559:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7751986d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293414528:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.968579:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293414400:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.968918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759173.969016:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293414912:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.969052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759173.969113:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787759173.969121:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293414272:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.969159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759173.969179:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293414784:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.969204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759173.969233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414272 00000100:00100000:3.0:1787759173.969245:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414272 00000100:00100000:3.0:1787759173.969316:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787759173.969328:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293414272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759173.969455:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414912 00000100:00100000:0.0:1787759173.969460:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414912 00000100:00100000:2.0:1787759173.969670:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7751984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293414656:0@lo:400:kworker.0 00000100:00100000:3.0:1787759173.969970:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293414272:12345-0@lo:400:kworker.0 Request processed in 643us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759173.969981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787759173.970158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759173.970159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759173.970217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414400 00000100:00100000:1.0:1787759173.970225:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414400 00000100:00100000:2.0:1787759173.970226:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414784 00000100:00100000:2.0:1787759173.970232:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414784 00000100:00100000:1.0:1787759173.970266:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414528 00000100:00100000:0.0:1787759173.970272:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293414656 00000100:00100000:1.0:1787759173.970272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414528 00000100:00100000:2.0:1787759173.970273:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787759173.970280:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293414656 00000100:00100000:2.0:1787759173.970288:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293414400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759173.970304:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759173.970315:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293414784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759173.970323:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787759173.970336:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293414912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.970341:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293414400:12345-0@lo:400:kworker.0 Request processed in 56us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759173.970349:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787759173.970404:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787759173.970409:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293414784:12345-0@lo:400:kworker.0 Request processed in 95us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759173.970415:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759173.970419:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293414912:12345-0@lo:400:kworker.0 Request processed in 86us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759173.970424:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787759173.970440:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787759173.970457:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787759173.970463:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293414656:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787759173.970486:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787759173.970492:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787759173.970505:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293414656:12345-0@lo:400:kworker.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759173.970512:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787759173.970664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293414272:0@lo:400:kworker.0 00000100:00100000:3.0:1787759173.970685:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293414784:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.970704:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293414528:12345-0@lo:400:kworker.0 Request processed in 292us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759173.970713:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293414400:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.970714:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787759173.970737:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77758c12c0 x1874601293414912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759173.970749:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293414912:0@lo:400:kworker.0 00010000:00080000:2.0:1787759173.970759:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7751984b40 x1874601293414656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759173.970772:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7751984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293414656:0@lo:400:kworker.0 00000100:00100000:2.0:1787759173.970806:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7751986d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293414528:0@lo:400:kworker.0 00000100:00100000:0.0:1787759174.478743:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787759174.478809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759174.478901:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415040 00000100:00100000:3.0:1787759174.478910:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415040 00000100:00100000:3.0:1787759174.479027:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787759174.479038:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759174.479073:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759174.479210:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759174.479218:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787759174.479527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77484452c0 x1874601293415040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759174.479581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787759174.798617:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759175.154261:0:9223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.105 00010000:00010000:3.0:1787759175.822754:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759175.996504:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759175.996570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759175.996605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759175.996615:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853952 00000100:00100000:2.0:1787759175.996630:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853952 00000100:00100000:1.0:1787759175.996662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:1.0:1787759175.996692:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759175.996718:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854080 00000100:00100000:2.0:1787759175.996722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:3.0:1787759175.996726:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854080 00000100:00100000:2.0:1787759175.996737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+6:2382:x1874601281853952:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1787759175.996778:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854208 00000100:00100000:3.0:1787759175.996782:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854208 00000100:00100000:0.0:1787759175.996798:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281853824 00000100:00100000:0.0:1787759175.996809:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281853824 00000100:00100000:3.0:1787759175.996814:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1787759175.996832:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c730f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281854080:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759175.996833:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+6:2382:x1874601281853952:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 96us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759175.996862:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c730f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281854080:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759175.996867:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1787759175.996886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00100000:3.0:1787759175.996893:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:3.0:1787759175.996908:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c730780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2382:x1874601281854208:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1787759175.996911:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281853824:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1787759175.996936:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c730780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2382:x1874601281854208:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759175.996959:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1787759175.996978:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281853824:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759175.996988:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 186 00000100:00080000:3.0:1787759175.996992:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759175.996999:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759175.997246:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000001:02000400:1.0:1787759176.240807:0:9320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.105 00010000:00010000:3.0:1787759176.846967:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759177.263137:0:9417:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.105 00010000:00010000:0.0:1787759177.870575:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759177.987951:0:9465:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-compr ============----- Wed Aug 26 11:46:17 EDT 2026 00000100:00100000:0.0:1787759178.575899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759178.575923:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787759178.575990:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759178.576063:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415168 00000100:00100000:0.0:1787759178.576071:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415168 00000100:00100000:0.0:1787759178.576129:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787759178.576139:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415168:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787759178.576149:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787759178.576175:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759178.576228:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759178.576236:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787759178.576256:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776dedc000 x1874601293415168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759178.576275:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759178.894819:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759179.086686:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293415424:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.086686:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748447840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293415296:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.086790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759179.086922:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.086955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293415552:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.086963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759179.087006:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759179.087014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759179.087016:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293415936:0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087052:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759179.087061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415680:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.087073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759179.087100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759179.087129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759179.087153:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415296 00000100:00100000:3.0:1787759179.087163:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415296 00000100:00100000:1.0:1787759179.087181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415808 00000100:00100000:1.0:1787759179.087188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415808 00000100:00100000:3.0:1787759179.087250:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787759179.087265:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293415296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759179.087267:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415552 00000100:00100000:1.0:1787759179.087274:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415552 00000100:00100000:1.0:1787759179.087295:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415424 00000100:00100000:1.0:1787759179.087298:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415424 00000100:00100000:1.0:1787759179.087323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787759179.087331:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087338:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293415296:12345-0@lo:400:kworker.0 Request processed in 77us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759179.087348:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787759179.087405:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293415808:12345-0@lo:400:kworker.0 Request processed in 74us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759179.087413:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787759179.087434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787759179.087441:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293415552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759179.087490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293415552:12345-0@lo:400:kworker.0 Request processed in 51us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759179.087498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787759179.087515:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787759179.087522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293415424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759179.087541:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293415552:0@lo:400:kworker.0 00000100:00100000:1.0:1787759179.087561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293415424:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759179.087568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787759179.087608:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293415424:0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087650:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415936 00000100:00100000:3.0:1787759179.087655:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415936 00000100:00100000:3.0:1787759179.087694:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293415680 00000100:00100000:3.0:1787759179.087698:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293415680 00000100:00100000:3.0:1787759179.087727:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759179.087735:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293415936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087783:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293415936:12345-0@lo:400:kworker.0 Request processed in 50us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759179.087790:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787759179.087809:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787759179.087815:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087860:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293415680:12345-0@lo:400:kworker.0 Request processed in 44us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759179.087866:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787759179.087889:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787759179.087895:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787759179.087918:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77484452c0 x1874601293415936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759179.087931:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293415936:0@lo:400:kworker.0 00010000:00080000:2.0:1787759179.087951:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748444b40 x1874601293415680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759179.087952:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293415808:0@lo:400:kworker.0 00000100:00100000:3.0:1787759179.087965:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748447840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293415296:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.088471:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293415680:0@lo:400:kworker.0 00000100:00100000:2.0:1787759179.598655:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748447840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293416064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759179.599358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759179.599444:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416064 00000100:00100000:1.0:1787759179.599455:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416064 00000100:00100000:1.0:1787759179.599552:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787759179.599575:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293416064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787759179.599624:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787759179.599698:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293416064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759179.599723:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787759179.599840:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748447840 x1874601293416064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759179.599869:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748447840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293416064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787759179.918530:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759180.942564:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759181.117233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759181.117290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759181.117322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759181.117351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759181.117400:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854720 00000100:00100000:3.0:1787759181.117410:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854720 00000100:00100000:0.0:1787759181.117462:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854336 00000100:00100000:3.0:1787759181.117475:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854592 00000100:00100000:0.0:1787759181.117477:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854336 00000100:00100000:3.0:1787759181.117478:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854592 00000100:00100000:2.0:1787759181.117491:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:1.0:1787759181.117502:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854464 00000100:00100000:1.0:1787759181.117508:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854464 00000100:00100000:2.0:1787759181.117511:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2382:x1874601281854720:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1787759181.117513:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:3.0:1787759181.117513:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:3.0:1787759181.117527:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281854592:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1787759181.117533:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281854336:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759181.117552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:1.0:1787759181.117562:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77484470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2382:x1874601281854464:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759181.117592:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2382:x1874601281854720:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759181.117595:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281854336:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 61us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759181.117595:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281854592:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759181.117604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77484470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2382:x1874601281854464:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759181.117609:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1787759181.117612:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 188 00000100:00100000:3.0:1787759181.117618:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1787759181.117621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00080000:3.0:1787759181.117661:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759181.117667:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787759181.117670:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787759181.966672:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759182.991529:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759183.695708:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293416192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759183.695780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759183.695895:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416192 00000100:00100000:0.0:1787759183.695902:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416192 00000100:00100000:0.0:1787759183.695979:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787759183.695988:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c733840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293416192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759183.696024:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759183.696073:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c733840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293416192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759183.696081:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787759183.696120:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776dedc000 x1874601293416192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759183.696138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293416192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787759183.696172:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787759184.014661:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759184.206651:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293416576:0@lo:400:kworker.0 00000100:00100000:3.0:1787759184.206722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759184.206786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787759184.206793:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293416704:0@lo:400:kworker.0 00000100:00100000:3.0:1787759184.206833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759184.206905:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416704 00000100:00100000:3.0:1787759184.206915:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416704 00000100:00100000:3.0:1787759184.206967:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787759184.206977:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293416704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759184.207046:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874601293416704:12345-0@lo:400:kworker.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759184.207055:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787759184.207115:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748444000 x1874601293416704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759184.207129:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874601293416704:0@lo:400:kworker.0 00000100:00100000:1.0:1787759184.208409:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293416320:0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208470:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416576 00000100:00100000:1.0:1787759184.208472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759184.208479:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416576 00000100:00100000:1.0:1787759184.208512:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293416832:0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208534:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787759184.208548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759184.208549:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293416576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759184.208576:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787759184.208585:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293416448:0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208604:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293416576:12345-0@lo:400:kworker.0 Request processed in 61us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759184.208612:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787759184.208621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759184.208631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416832 00000100:00100000:2.0:1787759184.208635:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416832 00000100:00100000:1.0:1787759184.208644:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293416960:0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416448 00000100:00100000:1.0:1787759184.208676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759184.208760:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416448 00000100:00100000:2.0:1787759184.208781:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759184.208787:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293416832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208839:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874601293416832:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759184.208846:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787759184.208859:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787759184.208866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293416448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787759184.208907:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293416448:12345-0@lo:400:kworker.0 Request processed in 30us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759184.208915:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787759184.208933:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293416448:0@lo:400:kworker.0 00000100:00100000:1.0:1787759184.208947:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293416832:0@lo:400:kworker.0 00000100:00080000:3.0:1787759184.209011:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759184.209030:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416960 00000100:00100000:3.0:1787759184.209034:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416960 00000100:00100000:3.0:1787759184.209074:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787759184.209081:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293416960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759184.209125:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c732d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293416960:12345-0@lo:400:kworker.0 Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759184.209139:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787759184.209173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293416576:0@lo:400:kworker.0 00010000:00080000:3.0:1787759184.209199:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748446580 x1874601293416960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759184.209209:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293416960:0@lo:400:kworker.0 00000100:00100000:0.0:1787759184.211243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293416320 00000100:00100000:0.0:1787759184.211254:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293416320 00000100:00100000:0.0:1787759184.211432:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787759184.211443:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293416320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759184.211520:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3303:x1874601293416320:12345-0@lo:400:kworker.0 Request processed in 80us (3048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759184.211528:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787759184.211586:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293416320:0@lo:400:kworker.0 00000100:00080000:2.0:1787759184.211659:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787759184.719697:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759184.719720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293417088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759184.719789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759184.719975:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417088 00000100:00100000:3.0:1787759184.719982:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417088 00000100:00100000:3.0:1787759184.720074:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787759184.720095:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293417088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759184.720133:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759184.720189:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293417088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759184.720198:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787759184.720292:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748446580 x1874601293417088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759184.720325:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293417088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787759185.038550:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759185.425653:0:10191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 00010000:00010000:0.0:1787759186.062493:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787759186.103407:0:10240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start setup 11:46:25 (1787759185) === 00000100:00100000:0.0:1787759186.238546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759186.238589:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759186.238599:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854848 00000100:00100000:3.0:1787759186.238609:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854848 00000100:00100000:3.0:1787759186.238658:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:3.0:1787759186.238667:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281854848:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759186.238690:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281854976 00000100:00100000:1.0:1787759186.238695:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281854976 00000100:00100000:3.0:1787759186.238736:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281854848:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759186.238742:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:3.0:1787759186.238748:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 190 00000100:00100000:1.0:1787759186.238754:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2381:x1874601281854976:12345-192.168.204.38@tcp:400:kworker.0 00000100:00080000:2.0:1787759186.238763:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759186.238790:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2381:x1874601281854976:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 41us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759186.238795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1787759186.239311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759186.239493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759186.239544:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855104 00000100:00100000:1.0:1787759186.239550:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855104 00000100:00100000:3.0:1787759186.239572:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855232 00000100:00100000:3.0:1787759186.239577:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855232 00000100:00100000:1.0:1787759186.239599:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:3.0:1787759186.239613:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1787759186.239615:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2380:x1874601281855104:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:1.0:1787759186.239643:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf590 00000100:00080000:1.0:1787759186.239654:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8d7641c87000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787759186.239662:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+5:2380:x1874601281855232:12345-192.168.204.38@tcp:9:kworker.0 00000020:00000080:3.0:1787759186.239691:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf597 00000100:00080000:3.0:1787759186.239698:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d777219f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787759186.239703:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:3.0:1787759186.239728:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1787759186.239966:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759186.240193:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+2:2380:x1874601281855232:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 571us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759186.240200:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:1.0:1787759186.240218:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+2:2380:x1874601281855104:12345-192.168.204.38@tcp:9:kworker.0 Request processed in 608us (904us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759186.240219:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759186.240228:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00080000:2.0:1787759186.240316:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787759186.240319:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787759187.087905:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759188.110621:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787759188.529600:0:10432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787759188.815512:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293417216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787759188.815579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759188.815627:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417216 00000100:00100000:3.0:1787759188.815636:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417216 00000100:00080000:2.0:1787759188.815674:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787759188.815703:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759188.815713:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293417216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787759188.815758:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759188.815833:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293417216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759188.815849:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787759188.815895:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776dede1c0 x1874601293417216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759188.815913:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dede1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293417216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759189.135835:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759189.327736:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293417472:0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.327823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759189.327893:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787759189.327900:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293417344:0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.327930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759189.327955:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293417856:0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.327988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759189.328025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417472 00000100:00100000:3.0:1787759189.328032:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417472 00000100:00100000:3.0:1787759189.328086:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787759189.328094:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.328148:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874601293417472:12345-0@lo:400:kworker.0 Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759189.328157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787759189.328175:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417856 00000100:00100000:0.0:1787759189.328180:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417856 00000100:00100000:3.0:1787759189.328180:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417344 00000100:00100000:3.0:1787759189.328182:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417344 00000100:00100000:3.0:1787759189.328202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787759189.328208:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293417344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759189.328217:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787759189.328223:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77484452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293417856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.328236:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293417344:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759189.328242:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787759189.328252:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77484452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293417856:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759189.328257:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787759189.328271:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759189.328289:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293417344:0@lo:400:kworker.0 00010000:00080000:3.0:1787759189.328303:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d7748446580 x1874601293417856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759189.328314:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293417856:0@lo:400:kworker.0 00000100:00100000:3.0:1787759189.328322:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874601293417472:0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328457:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293417600:0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759189.328514:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759189.328520:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293417728:0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759189.328574:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417600 00000100:00100000:1.0:1787759189.328578:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417600 00000100:00100000:1.0:1787759189.328608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417728 00000100:00100000:1.0:1787759189.328611:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417728 00000100:00100000:1.0:1787759189.328631:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787759189.328637:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293417600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328674:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c7330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293417600:12345-0@lo:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759189.328681:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787759189.328694:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787759189.328701:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293417728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328727:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293417728:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759189.328733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787759189.328763:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293417728:0@lo:400:kworker.0 00000100:00100000:1.0:1787759189.328772:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293417600:0@lo:400:kworker.0 00000100:00080000:0.0:1787759189.329269:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1787759189.346640:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:1.0:1787759189.346648:0:6705:0:(genops.c:885:class_export_put()) final put ffff8d7641c84000/e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:3.0:1787759189.346669:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641c84000/e27cd7ed-1056-4119-a592-11d825b15827 for lustre-OST0000 00000020:00000080:3.0:1787759189.346713:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7641c87000 for lustre-OST0000 00000100:00100000:1.0:1787759189.839831:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787759189.840093:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293417984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759189.840183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759189.840403:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293417984 00000100:00100000:0.0:1787759189.840410:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293417984 00000100:00100000:0.0:1787759189.840459:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787759189.840471:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293417984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787759189.840509:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759189.840565:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293417984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759189.840572:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787759189.840617:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77484461c0 x1874601293417984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759189.840636:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293417984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787759190.160796:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787759190.877942:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:3.0:1787759190.877952:0:7631:0:(genops.c:885:class_export_put()) final put ffff8d7772199800/e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:1.0:1787759190.877992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7772199800/e27cd7ed-1056-4119-a592-11d825b15827 for lustre-OST0001 00000020:00000080:1.0:1787759190.878085:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d777219f800 for lustre-OST0001 00010000:00010000:3.0:1787759191.182571:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759191.355225:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759191.355270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759191.355327:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855360 00000100:00100000:3.0:1787759191.355337:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855360 00000100:00100000:3.0:1787759191.355411:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:3.0:1787759191.355429:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281855360:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759191.355446:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855488 00000100:00100000:1.0:1787759191.355451:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855488 00000100:00100000:1.0:1787759191.355495:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00100000:3.0:1787759191.355499:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281855360:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759191.355507:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2381:x1874601281855488:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1787759191.355512:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 192 00000100:00100000:1.0:1787759191.355548:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:2381:x1874601281855488:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759191.355555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 36 00000100:00080000:1.0:1787759191.355574:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787759192.208640:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759193.231473:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759193.934572:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787759193.934596:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293418112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759193.934668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759193.934778:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418112 00000100:00100000:1.0:1787759193.934785:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418112 00000100:00100000:1.0:1787759193.934848:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787759193.934857:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293418112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787759193.934892:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787759193.934937:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293418112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759193.934944:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787759193.934981:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d84d2c0 x1874601293418112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759193.934998:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293418112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787759193.935069:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787759194.254536:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759194.446946:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293418624:0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.446946:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293418368:0@lo:400:kworker.0 00000100:00100000:2.0:1787759194.447044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759194.447049:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293418240:0@lo:400:kworker.0 00000100:00100000:1.0:1787759194.447090:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293418496:0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.447111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759194.447177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759194.447180:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293418752:0@lo:400:kworker.0 00000100:00100000:2.0:1787759194.447215:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418240 00000100:00100000:2.0:1787759194.447224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418240 00000100:00100000:3.0:1787759194.447259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759194.447281:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418624 00000100:00100000:1.0:1787759194.447291:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418624 00000100:00100000:2.0:1787759194.447298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787759194.447311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3306:x1874601293418240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.447337:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418752 00000100:00100000:3.0:1787759194.447343:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418752 00000100:00100000:1.0:1787759194.447401:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418496 00000100:00100000:1.0:1787759194.447408:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418496 00000100:00100000:1.0:1787759194.447462:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787759194.447476:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293418624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.447485:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759194.447499:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748446d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293418752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759194.447562:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874601293418624:12345-0@lo:400:kworker.0 Request processed in 88us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759194.447581:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787759194.447582:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748446d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293418752:12345-0@lo:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759194.447595:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787759194.447612:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787759194.447626:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293418496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.447660:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759194.447688:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874601293418496:12345-0@lo:400:kworker.0 Request processed in 63us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759194.447710:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787759194.447733:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418368 00000100:00100000:1.0:1787759194.447738:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418368 00000100:00100000:1.0:1787759194.447762:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787759194.447770:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293418368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759194.447813:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293418368:12345-0@lo:400:kworker.0 Request processed in 45us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759194.447820:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787759194.448833:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3306:x1874601293418240:12345-0@lo:400:kworker.0 Request processed in 1521us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759194.448856:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787759194.449866:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293418240:0@lo:400:kworker.0 00010000:00080000:3.0:1787759194.450018:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d84e1c0 x1874601293418752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787759194.450045:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759194.450048:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293418752:0@lo:400:kworker.0 00000100:00080000:1.0:1787759194.450122:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759194.450181:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874601293418496:0@lo:400:kworker.0 00000100:00100000:3.0:1787759194.450245:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293418624:0@lo:400:kworker.0 00000100:00100000:1.0:1787759194.450268:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293418368:0@lo:400:kworker.0 00000100:00100000:1.0:1787759194.958601:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293418880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787759194.958676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759194.958767:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293418880 00000100:00100000:3.0:1787759194.958776:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293418880 00000100:00100000:3.0:1787759194.958828:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787759194.958838:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293418880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759194.958873:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759194.958925:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293418880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759194.958932:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787759194.959163:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77484461c0 x1874601293418880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759194.959181:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293418880:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787759195.166604:0:11131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787759195.278572:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.302633:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759196.475283:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759196.475357:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855616 00000100:00100000:2.0:1787759196.475386:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855616 00000100:00100000:2.0:1787759196.475442:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:2.0:1787759196.475453:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281855616:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759196.475545:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281855616:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.475555:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 194 00000100:00100000:2.0:1787759196.476049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759196.476106:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855744 00000100:00100000:1.0:1787759196.476112:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855744 00000100:00100000:1.0:1787759196.476179:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00100000:1.0:1787759196.476187:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+6:2383:x1874601281855744:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759196.476233:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+6:2383:x1874601281855744:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 46us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759196.476240:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 40 00000100:00080000:0.0:1787759196.476911:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787759196.519105:0:11279:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfba0bb80 20000000:00000080:2.0:1787759196.519118:0:11279:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d7641e3f000 uarg=0000000000000000 20000000:01000000:2.0:1787759196.519146:0:11279:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787759196.519150:0:11279:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787759196.519154:0:11279:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787759196.519650:0:11280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787759196.519745:0:11279:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787759196.523763:0:11279:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787759196.523793:0:11279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523812:0:11279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf62a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523822:0:11279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf638 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523829:0:11279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf646 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523853:0:11279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523861:0:11279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523901:0:11279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.523916:0:11279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 9 pid: 5829 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.523930:0:11279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419008:192.168.204.38@tcp:104: 00010000:00010000:1.0:1787759196.524040:0:11279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.524049:0:11279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 18 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.524059:0:11279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419136:0@lo:104: 00000100:00100000:1.0:1787759196.524099:0:11279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759196.524141:0:11279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.524151:0:11279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 18 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759196.524159:0:11279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419264:0@lo:104: 00000100:00100000:2.0:1787759196.524171:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419136 00000100:00100000:2.0:1787759196.524178:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419136 00000100:00100000:1.0:1787759196.524193:0:11279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787759196.524224:0:11279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759196.524234:0:11279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 18 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.524236:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419264 00000100:00100000:2.0:1787759196.524242:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419264 00000100:00100000:1.0:1787759196.524248:0:11279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419392:0@lo:104: 00000100:00100000:1.0:1787759196.524268:0:11279:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.524278:0:11279:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787759196.524293:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419392 00000100:00100000:0.0:1787759196.524299:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419392 00000100:00100000:3.0:1787759196.524338:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787759196.524353:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:11279:x1874601293419136:12345-0@lo:104: 00000100:00100000:2.0:1787759196.524359:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787759196.524388:0:6314:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:2.0:1787759196.524395:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:11279:x1874601293419264:12345-0@lo:104: 00000100:00100000:0.0:1787759196.524398:0:6314:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:3.0:1787759196.524477:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524478:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524554:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787759196.524562:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:11279:x1874601293419264:12345-0@lo:104: Request processed in 195us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759196.524568:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787759196.524578:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+5:11279:x1874601293419136:12345-0@lo:104: Request processed in 229us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.524586:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759196.524591:0:11279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419136:0@lo:104: 00000100:00100000:1.0:1787759196.524602:0:11279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419264:0@lo:104: 00000100:00100000:2.0:1787759196.524669:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787759196.524676:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:11279:x1874601293419392:12345-0@lo:104: 00010000:00010000:2.0:1787759196.524684:0:5818:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.524739:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787759196.524745:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1787759196.524750:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.524751:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+4:11279:x1874601293419392:12345-0@lo:104: Request processed in 76us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.524765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787759196.524771:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ec00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759196.524776:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524783:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759196.524786:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524788:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524805:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782174e00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759196.524806:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759196.524808:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.524825:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759196.524826:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1787759196.524836:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759196.524840:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759196.524866:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.524874:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787759196.524881:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759196.524888:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787759196.524891:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759196.524894:0:11279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419392:0@lo:104: 00010000:00010000:0.0:1787759196.524900:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.524910:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166ec00/0x662cc405a6abf638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf63f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.524924:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787759196.524941:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.524949:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.524951:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7782174e00/0x662cc405a6abf646 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf64d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.524953:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759196.524957:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.524966:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.524971:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759196.524973:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759196.524974:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293419520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787759196.525000:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293419648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759196.525018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759196.525048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759196.525069:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419520 00000100:00100000:2.0:1787759196.525073:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419520 00000100:00100000:0.0:1787759196.525081:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419648 00000100:00100000:0.0:1787759196.525087:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419648 00010000:00010000:2.0:1787759196.525095:0:5866:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.525108:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525114:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.525122:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.525128:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787759196.525142:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3304:x1874601293419520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759196.525142:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ee00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759196.525152:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.525155:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787759196.525164:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787759196.525164:0:5866:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525165:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.525179:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77485d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3305:x1874601293419648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787759196.525185:0:5866:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759196.525186:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759196.525202:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787759196.525207:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759196.525211:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77609e2a00/0x662cc405a6abf63f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf638 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.525217:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 20 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525227:0:5823:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.525229:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787759196.525233:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 19 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525238:0:5823:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759196.525253:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175200/0x662cc405a6abf64d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf646 expref: 19 pid: 5828 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.525264:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759196.525269:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3304:x1874601293419520:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759196.525277:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787759196.525299:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293419776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759196.525329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787759196.525477:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525486:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166ee00/0x662cc405a6abf62a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x662cc405a6abf631 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525503:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.525506:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759196.525508:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77485d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:3305:x1874601293419648:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (459us total) trans 0 rc 0/0 00010000:00010000:3.0:1787759196.525510:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759196.525521:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787759196.525521:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293419648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759196.525527:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759196.525532:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759196.525553:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419776 00000100:00100000:3.0:1787759196.525557:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419776 00010000:00010000:3.0:1787759196.525576:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.525603:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dedc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293419520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759196.525611:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787759196.525624:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:3306:x1874601293419776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759196.525640:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759196.525646:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525668:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525747:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81200/0x662cc405a6abf631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x662cc405a6abf62a expref: 17 pid: 5829 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759196.525759:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759196.525799:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3306:x1874601293419776:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759196.525805:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787759196.525814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293419776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759196.525834:0:11279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11279:1874601293419008:192.168.204.38@tcp:104: 00010000:00010000:0.0:1787759196.525857:0:11279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759196.526167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759196.526311:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281855872 00000100:00100000:0.0:1787759196.526316:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281855872 00010000:00010000:0.0:1787759196.526333:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.526357:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1787759196.526362:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2383:x1874601281855872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787759196.526386:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759196.526390:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526399:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526412:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d77609e2c00/0x662cc405a6abf654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0x114de731f7635050 expref: 10 pid: 5829 timeout: 260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526423:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526431:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526443:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526461:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526466:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526470:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526482:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175000 already unused, calling callback (ffffffffc144d530) 00010000:00010000:0.0:1787759196.526489:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526497:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526513:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759196.526526:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759196.526533:0:11279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.526542:0:11279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759196.526547:0:11279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf65b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759196.526627:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:2383:x1874601281855872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 263us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759196.526635:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00010000:00010000:3.0:1787759197.326532:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787759197.710447:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787759197.710455:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7641cc9000 from 7 10000000:01000000:2.0:1787759197.710460:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787759197.710506:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.710517:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.710529:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759197.710554:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293419904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.710621:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759197.710683:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787759197.710802:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293419904 00000100:00100000:3.0:1787759197.710810:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293419904 00000100:00100000:3.0:1787759197.710863:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787759197.710873:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:5832:x1874601293419904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787759197.710886:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759197.710899:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf669 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf662 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.710922:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf662 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.710934:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf669 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf662 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.710943:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166ee00, rc 0) 00000100:00100000:3.0:1787759197.711010:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293419904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759197.711018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1787759197.711435:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293419904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759197.711455:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.711466:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759197.711527:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.711556:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.711579:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787759197.712301:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420032 00000100:00100000:3.0:1787759197.712305:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420032 00000100:00100000:3.0:1787759197.712447:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787759197.712454:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293420032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787759197.712713:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293420032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759197.712722:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787759197.712748:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.712915:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.712957:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.712997:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787759197.713059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420160 00000100:00100000:3.0:1787759197.713063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420160 00000100:00100000:3.0:1787759197.713103:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787759197.713363:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293420160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787759197.713544:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293420160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 434us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759197.713553:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1787759197.713576:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787759197.715003:0:11434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787759197.715104:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787759197.715128:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787759197.715137:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.715147:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759197.715155:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787759197.715157:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7773d06800 from 7 10000000:01000000:3.0:1787759197.715159:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787759197.715188:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.715195:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759197.715204:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759197.715221:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787759197.715257:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759197.715283:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d7747a22840 going to sleep for 11 seconds 00000100:00100000:1.0:1787759197.715304:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420288 00000100:00100000:1.0:1787759197.715310:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420288 00000100:00100000:1.0:1787759197.715347:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787759197.715356:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:5832:x1874601293420288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759197.715387:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759197.715400:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782175000/0x662cc405a6abf677 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf670 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.715422:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782175000/0x662cc405a6abf677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf670 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.715433:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782175000/0x662cc405a6abf677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf670 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.715441:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175000, rc 0) 00000100:00100000:1.0:1787759197.715483:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759197.715491:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787759197.715520:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7748445e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759197.715539:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.715550:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759197.715599:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.715627:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.715667:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420416 00000100:00100000:2.0:1787759197.715670:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759197.715672:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420416 00000100:00100000:1.0:1787759197.715699:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787759197.715708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.715955:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759197.715960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787759197.715991:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.716020:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.716054:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759197.716071:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d77483a96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787759197.716072:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420544 00000100:00100000:1.0:1787759197.716077:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420544 00000100:00100000:1.0:1787759197.716094:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787759197.716100:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.716222:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759197.716230:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787759197.716252:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77758c12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787759197.716973:0:11435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787759197.717049:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787759197.717077:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787759197.717084:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.717094:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759197.717104:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787759197.717105:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d7758776000 from 7 10000000:01000000:1.0:1787759197.717108:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787759197.717128:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.717142:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.717150:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759197.717174:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.717205:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.717238:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759197.717300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420672 00000100:00100000:2.0:1787759197.717305:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420672 00000100:00100000:2.0:1787759197.717333:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1787759197.717341:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:5832:x1874601293420672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787759197.717349:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759197.717359:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x662cc405a6abf67e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.717398:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x662cc405a6abf67e expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.717408:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x662cc405a6abf67e expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.717421:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81000, rc 0) 00000100:00100000:1.0:1787759197.717497:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.717500:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293420672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759197.717508:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00010000:1.0:1787759197.717509:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759197.717518:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759197.717562:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.717592:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.717622:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759197.717821:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420800 00000100:00100000:2.0:1787759197.717825:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420800 00000100:00100000:2.0:1787759197.717856:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787759197.717862:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293420800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.718021:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293420800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759197.718028:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787759197.718136:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.718164:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759197.718198:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759197.718217:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d777c8b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787759197.718234:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293420928 00000100:00100000:2.0:1787759197.718239:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293420928 00000100:00100000:2.0:1787759197.718262:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787759197.718270:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293420928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787759197.718416:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:5832:x1874601293420928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759197.718425:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787759197.718434:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:5832:1874601293420928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787759197.719605:0:11436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787759197.719734:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787759197.719746:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787759197.719752:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759197.719759:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1787759197.900712:0:11478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg438-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787759198.332326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759198.332421:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856000 00000100:00100000:1.0:1787759198.332429:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856000 00000100:00100000:1.0:1787759198.332501:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:1.0:1787759198.332509:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:5616:x1874601281856000:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787759198.332522:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759198.332551:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf68c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x114de731f7635057 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759198.332574:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635057 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759198.332582:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635057 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759198.332588:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782174e00, rc 0) 00000100:00100000:1.0:1787759198.332654:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281856000:12345-192.168.204.38@tcp:101:ll_cfg_requeue.0 Request processed in 145us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759198.332662:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 204 00000100:00100000:3.0:1787759198.334081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759198.334142:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856128 00000100:00100000:2.0:1787759198.334147:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856128 00000100:00100000:2.0:1787759198.334189:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:2.0:1787759198.334197:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281856128:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787759198.334520:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281856128:12345-192.168.204.38@tcp:501:ll_cfg_requeue.0 Request processed in 323us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759198.334529:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 205 00000100:00100000:0.0:1787759198.335734:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759198.335789:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856256 00000100:00100000:1.0:1787759198.335795:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856256 00000100:00100000:1.0:1787759198.335839:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 206 00000100:00100000:1.0:1787759198.335848:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281856256:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787759198.336015:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:5616:x1874601281856256:12345-192.168.204.38@tcp:503:ll_cfg_requeue.0 Request processed in 167us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759198.336023:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 206 00010000:00010000:2.0:1787759198.350571:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759199.054647:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293421056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787759199.054750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759199.054838:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421056 00000100:00100000:1.0:1787759199.054849:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421056 00000100:00080000:0.0:1787759199.054898:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787759199.054946:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787759199.054960:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293421056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787759199.055011:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787759199.055076:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293421056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.055086:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787759199.055121:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d84da40 x1874601293421056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759199.055144:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293421056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787759199.374699:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787759199.399723:0:11577:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish setup 11:46:38 (1787759198) === 00000100:00100000:0.0:1787759199.490027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.490092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856384 00000100:00100000:2.0:1787759199.490103:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856384 00000100:00080000:0.0:1787759199.490148:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787759199.490161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:2.0:1787759199.490170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e27cd7ed-1056-4119-a592-11d825b15827+6:9836:x1874601281856384:12345-192.168.204.38@tcp:700:mkdir.0 00000100:00100000:2.0:1787759199.490243:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dede940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e27cd7ed-1056-4119-a592-11d825b15827+6:9836:x1874601281856384:12345-192.168.204.38@tcp:700:mkdir.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759199.490248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 0 00000100:00100000:3.0:1787759199.491294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.491342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856640 00000100:00100000:1.0:1787759199.491351:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856640 00000100:00100000:1.0:1787759199.491429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 10 00000100:00100000:1.0:1787759199.491439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:9836:x1874601281856640:12345-192.168.204.38@tcp:36:mkdir.0 00010000:00010000:1.0:1787759199.491482:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759199.491536:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2400/0x662cc405a6abf5a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763503b expref: 6 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491555:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7743c92800) 00010000:00010000:1.0:1787759199.491566:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759199.491904:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491917:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491927:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491954:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491962:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.491968:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.493443:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787759199.493456:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493470:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493476:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493482:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782174400 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.493487:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493495:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493505:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:1.0:1787759199.493508:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.493512:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.493517:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf693 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759199.493531:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ef6417b reply state 000000000eb70c7b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.493540:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787759199.493688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+7:9836:x1874601281856640:12345-192.168.204.38@tcp:36:mkdir.0 Request processed in 2249us (2392us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787759199.493696:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 10 00010000:00010000:2.0:1787759199.495073:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495172:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495180:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495199:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175400 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:2.0:1787759199.495203:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495210:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495223:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7750ca3b00) 00010000:00010000:2.0:1787759199.495226:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787759199.495230:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.495236:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf69a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759199.502709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.502806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281856768 00000100:00100000:2.0:1787759199.502815:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281856768 00000100:00100000:2.0:1787759199.502870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:2.0:1787759199.502882:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77484461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+6:9837:x1874601281856768:12345-192.168.204.38@tcp:101:chmod.0 00010000:00010000:2.0:1787759199.502904:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759199.502923:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763505e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.503808:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.503821:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.503830:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787759199.503903:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787759199.503907:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787759199.504024:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.504324:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763505e expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.504345:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763505e expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.504353:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775923df00) 00010000:00010000:2.0:1787759199.504356:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787759199.504359:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a80600, rc 0) 00000100:00100000:2.0:1787759199.504683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77484461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+7:9837:x1874601281856768:12345-192.168.204.38@tcp:101:chmod.0 Request processed in 1802us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759199.504694:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11 00000100:00100000:0.0:1787759199.506780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.506855:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857024 00000100:00100000:3.0:1787759199.506875:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857024 00000100:00100000:3.0:1787759199.506950:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1787759199.506962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+7:9837:x1874601281857024:12345-192.168.204.38@tcp:36:chmod.0 00010000:00010000:3.0:1787759199.507042:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759199.507082:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf6a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763505e expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.507118:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775923df00) 00010000:00010000:3.0:1787759199.507132:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759199.507159:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.507171:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.507178:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787759199.507564:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008091b8ad reply state 000000001756387a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759199.507572:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787759199.507586:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787759199.507699:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+8:9837:x1874601281857024:12345-192.168.204.38@tcp:36:chmod.0 Request processed in 739us (931us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787759199.507705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00010000:00010000:3.0:1787759199.508976:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.508988:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.508994:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.508998:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e400 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.509002:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.509018:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.509034:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:3.0:1787759199.509037:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787759199.509042:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.509048:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.522196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.522274:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857152 00000100:00100000:1.0:1787759199.522283:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857152 00000100:00100000:1.0:1787759199.522360:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:1.0:1787759199.522400:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+7:9838:x1874601281857152:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:1.0:1787759199.522427:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.522451:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf6b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f7635065 expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522514:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522538:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522548:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.522619:0:6792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787759199.522622:0:6792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787759199.522662:0:6792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522686:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782174400/0x662cc405a6abf6b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635065 expref: 9 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522703:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635065 expref: 8 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.522710:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:1.0:1787759199.522713:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787759199.522716:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7782175600, rc 0) 00000100:00100000:1.0:1787759199.522773:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+8:9838:x1874601281857152:12345-192.168.204.38@tcp:101:chown.0 Request processed in 405us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.522785:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1787759199.525016:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.525103:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857280 00000100:00100000:1.0:1787759199.525111:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857280 00000100:00100000:1.0:1787759199.525154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1787759199.525163:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+8:9838:x1874601281857280:12345-192.168.204.38@tcp:101:chown.0 00010000:00010000:1.0:1787759199.525180:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.525197:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf6c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763506c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525267:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525279:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525289:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525303:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525310:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525317:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525439:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525458:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525465:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.525509:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787759199.525514:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787759199.525532:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525543:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525550:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525557:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525563:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972c00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.525568:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525576:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525587:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:1.0:1787759199.525590:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.525606:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525623:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525636:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525643:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525649:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525654:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972a00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.525656:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525663:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525671:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7750ca3700) 00010000:00010000:1.0:1787759199.525673:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.525676:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525680:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf6d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175400/0x662cc405a6abf6c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763506c expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525726:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763506c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.525740:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7750ca3500) 00010000:00010000:1.0:1787759199.525743:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787759199.525745:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d972400, rc 0) 00000100:00100000:1.0:1787759199.525799:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+9:9838:x1874601281857280:12345-192.168.204.38@tcp:101:chown.0 Request processed in 637us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.525807:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:0.0:1787759199.528582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.528655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857536 00000100:00100000:2.0:1787759199.528664:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857536 00000100:00100000:2.0:1787759199.528716:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 15 00000100:00100000:2.0:1787759199.528724:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+9:9838:x1874601281857536:12345-192.168.204.38@tcp:36:chown.0 00010000:00010000:2.0:1787759199.528763:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787759199.528783:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972400/0x662cc405a6abf6d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763506c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.528795:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7750ca3500) 00010000:00010000:2.0:1787759199.528813:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787759199.528832:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.528841:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.528848:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787759199.544590:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787759199.544617:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787759199.544631:0:5836:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfff5cf1 reply state 00000000194ea6d5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759199.544648:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787759199.544764:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787759199.544856:0:5836:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787759199.544876:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+7:9838:x1874601281857536:12345-192.168.204.38@tcp:36:chown.0 Request processed in 16148us (16298us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787759199.544886:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 15 00010000:00010000:3.0:1787759199.544922:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.544931:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.544939:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.544945:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a81600 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.544950:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.544966:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.544993:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775923d100) 00010000:00010000:3.0:1787759199.544996:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787759199.545001:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.545008:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf6e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.557004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.557156:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857664 00000100:00100000:3.0:1787759199.557165:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857664 00000100:00100000:3.0:1787759199.557221:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:3.0:1787759199.557231:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:9839:x1874601281857664:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:3.0:1787759199.557254:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759199.557274:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f7635073 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787759199.558356:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 937us 00010000:00010000:3.0:1787759199.565963:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.565979:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.565988:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.566008:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.566013:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.566017:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.566527:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293421312:0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.566575:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293421184:0@lo:400:kworker.0 00000100:00100000:1.0:1787759199.566615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759199.566631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759199.566678:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293421696:0@lo:400:kworker.0 00000100:00100000:1.0:1787759199.566682:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787759199.566692:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293421440:0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.566708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759199.566731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759199.566737:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1787759199.566737:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.566748:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293421568:0@lo:400:kworker.0 00010000:00010000:3.0:1787759199.566749:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.566772:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421312 00000100:00100000:1.0:1787759199.566780:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421312 00000100:00100000:0.0:1787759199.566785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759199.566818:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421440 00000100:00100000:1.0:1787759199.566822:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421440 00000100:00100000:0.0:1787759199.566828:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421184 00000100:00100000:0.0:1787759199.566834:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421184 00000100:00100000:1.0:1787759199.566850:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421568 00000100:00100000:1.0:1787759199.566854:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421568 00000100:00100000:1.0:1787759199.566878:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787759199.566887:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293421312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.566889:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787759199.566902:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293421184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759199.566955:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874601293421312:12345-0@lo:400:kworker.0 Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759199.566963:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293421184:12345-0@lo:400:kworker.0 Request processed in 62us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759199.566975:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787759199.566978:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787759199.566999:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787759199.567009:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293421440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.567013:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421696 00000100:00100000:0.0:1787759199.567018:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421696 00000100:00100000:1.0:1787759199.567047:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293421440:12345-0@lo:400:kworker.0 Request processed in 41us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.567061:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787759199.567076:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787759199.567081:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787759199.567089:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776deded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293421696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759199.567094:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293421568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.567143:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776deded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874601293421696:12345-0@lo:400:kworker.0 Request processed in 57us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.567146:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874601293421568:12345-0@lo:400:kworker.0 Request processed in 56us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.567306:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787759199.567345:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293421440:0@lo:400:kworker.0 00000100:00100000:1.0:1787759199.567357:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874601293421312:0@lo:400:kworker.0 00010000:00010000:3.0:1787759199.567770:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759199.567933:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787759199.567938:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1787759199.567941:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787759199.568022:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787759199.568034:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787759199.569303:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293421568:0@lo:400:kworker.0 00000100:00100000:0.0:1787759199.569323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293421184:0@lo:400:kworker.0 00010000:00080000:0.0:1787759199.569340:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d84ed00 x1874601293421696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787759199.569352:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874601293421696:0@lo:400:kworker.0 00000004:00010000:3.0:1787759199.569358:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569396:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569404:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569412:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569429:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ec00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.569433:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569440:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569467:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:3.0:1787759199.569471:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.569477:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569483:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf6ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569505:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569511:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569517:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569523:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ea00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.569526:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569531:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569550:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d775b85d700) 00010000:00010000:3.0:1787759199.569562:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.569566:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569572:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf6f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569634:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635073 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569650:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635073 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.569657:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:3.0:1787759199.569661:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787759199.569663:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166e200, rc 0) 00000100:00100000:3.0:1787759199.569724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+7:9839:x1874601281857664:12345-192.168.204.38@tcp:101:touch.500 Request processed in 12494us (12730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.569733:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 16 00000100:00100000:0.0:1787759199.572031:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.572101:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281857920 00000100:00100000:1.0:1787759199.572110:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281857920 00000100:00100000:1.0:1787759199.572156:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:1.0:1787759199.572178:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+7:9839:x1874601281857920:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:1.0:1787759199.572196:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.572216:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf703 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763507a expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572539:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572555:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572566:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572635:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572652:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.572660:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787759199.573458:0:6792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787759199.573722:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973200/0x662cc405a6abf718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573733:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973200/0x662cc405a6abf718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573741:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973200/0x662cc405a6abf718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573773:0:6792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573779:0:6792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573786:0:6792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573792:0:6792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972c00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.573796:0:6792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573803:0:6792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573823:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:1.0:1787759199.573826:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.573831:0:6792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573837:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf70a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759199.573848:0:6792:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001c26b9f reply state 0000000073b246fb transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.573856:0:6792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787759199.573884:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf703 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763507a expref: 10 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573896:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973200/0x662cc405a6abf718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763507a expref: 9 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.573903:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7750ca3700) 00010000:00010000:1.0:1787759199.573905:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787759199.573908:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d973200, rc 0) 00000100:00100000:1.0:1787759199.573964:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+10:9839:x1874601281857920:12345-192.168.204.38@tcp:101:touch.500 Request processed in 1788us (1935us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787759199.573973:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00010000:00010000:3.0:1787759199.577497:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577511:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577518:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577538:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973600 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.577543:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577550:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577563:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8d7750ca3a00) 00010000:00010000:3.0:1787759199.577566:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.577571:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.577577:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973600/0x662cc405a6abf711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.577848:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.577887:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858176 00000100:00100000:3.0:1787759199.577933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858176 00000100:00100000:3.0:1787759199.577983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:3.0:1787759199.577994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+9:9839:x1874601281858176:12345-192.168.204.38@tcp:36:touch.500 00010000:00010000:3.0:1787759199.578042:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759199.578060:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973200/0x662cc405a6abf718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763507a expref: 9 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.578072:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7750ca3700) 00010000:00010000:3.0:1787759199.578081:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759199.578116:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.578127:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.578143:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787759199.578252:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f6157bc reply state 0000000054a54851 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759199.578260:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787759199.578333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+10:9839:x1874601281858176:12345-192.168.204.38@tcp:36:touch.500 Request processed in 340us (485us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787759199.578340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000100:00100000:0.0:1787759199.579775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.579873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858304 00000100:00100000:1.0:1787759199.579880:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858304 00010000:00010000:3.0:1787759199.579880:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.579892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.579899:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.579916:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e400 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.579921:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.579927:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.579939:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d775b85d700) 00010000:00010000:3.0:1787759199.579942:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.579946:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759199.579954:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:3.0:1787759199.579966:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf726 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759199.579968:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+10:9839:x1874601281858304:12345-192.168.204.38@tcp:101:touch.500 00010000:00010000:2.0:1787759199.579990:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759199.580007:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf72d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f7635081 expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.580047:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf72d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635081 expref: 10 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.580059:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf72d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635081 expref: 10 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.580084:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d775923d800) 00010000:00010000:2.0:1787759199.580087:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787759199.580090:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81600, rc 0) 00000100:00100000:2.0:1787759199.580129:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dedd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+10:9839:x1874601281858304:12345-192.168.204.38@tcp:101:touch.500 Request processed in 166us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759199.580135:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00000100:00100000:0.0:1787759199.581561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.581654:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858432 00000100:00100000:3.0:1787759199.581660:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858432 00000100:00100000:3.0:1787759199.581689:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:3.0:1787759199.581694:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2380:x1874601281858432:12345-192.168.204.38@tcp:8:touch.500 00010000:00080000:3.0:1787759199.581717:0:6679:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from e27cd7ed-1056-4119-a592-11d825b15827@192.168.204.38@tcp t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:3.0:1787759199.581754:0:6679:0:(genops.c:1385:class_connect()) connect: client e27cd7ed-1056-4119-a592-11d825b15827, cookie 0x662cc405a6abf734 00002000:00100000:3.0:1787759199.581763:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e27cd7ed-1056-4119-a592-11d825b15827/ffff8d7747b7c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113969 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787759199.581773:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787759199.581961:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787759199.582257:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d7747b7b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787759199.582311:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dede1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e27cd7ed-1056-4119-a592-11d825b15827+6:2380:x1874601281858432:12345-192.168.204.38@tcp:8:touch.500 Request processed in 615us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.582318:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12 00000100:00100000:0.0:1787759199.583293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.583406:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858560 00000100:00100000:2.0:1787759199.583423:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858560 00000100:00080000:0.0:1787759199.583452:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787759199.583477:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:2.0:1787759199.583485:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+6:0:x1874601281858560:12345-192.168.204.38@tcp:2:touch.500 00000001:00080000:1.0:1787759199.596529:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787759199.596547:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000100:00100000:3.0:1787759199.596767:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dede580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e27cd7ed-1056-4119-a592-11d825b15827+5:0:x1874601281858560:12345-192.168.204.38@tcp:2:touch.500 Request processed in 13277us (13469us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787759199.596778:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 13 00000100:00100000:0.0:1787759199.598427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.598478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858816 00000100:00100000:3.0:1787759199.598486:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858816 00000100:00100000:3.0:1787759199.598536:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:3.0:1787759199.598543:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+10:9839:x1874601281858816:12345-192.168.204.38@tcp:35:touch.500 00000100:00100000:3.0:1787759199.598842:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+11:9839:x1874601281858816:12345-192.168.204.38@tcp:35:touch.500 Request processed in 298us (417us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787759199.598860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1 00000100:00100000:0.0:1787759199.606459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.606525:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281858944 00000100:00100000:3.0:1787759199.606534:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281858944 00000100:00100000:3.0:1787759199.606588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:3.0:1787759199.606609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+11:9840:x1874601281858944:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1787759199.606643:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759199.606664:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf73b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f7635088 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606726:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606739:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606749:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759199.606819:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787759199.606823:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787759199.606891:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606918:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf73b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635088 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606948:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635088 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.606968:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:3.0:1787759199.606971:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787759199.606974:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d774166ea00, rc 0) 00000100:00100000:3.0:1787759199.607040:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+12:9840:x1874601281858944:12345-192.168.204.38@tcp:101:rm.0 Request processed in 442us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.607047:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:0.0:1787759199.608843:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.608990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281859200 00000100:00100000:1.0:1787759199.609003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281859200 00000100:00100000:1.0:1787759199.609048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:1.0:1787759199.609071:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+12:9840:x1874601281859200:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1787759199.609087:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.609108:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763508f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.609214:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787759199.609417:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf749 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763508f expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.609432:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:1.0:1787759199.609435:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787759199.609440:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763508f expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.609465:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d972a00, rc 0) 00000100:00100000:1.0:1787759199.609514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+13:9840:x1874601281859200:12345-192.168.204.38@tcp:101:rm.0 Request processed in 445us (683us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787759199.609521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1787759199.611802:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.612086:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281859328 00000100:00100000:3.0:1787759199.612094:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281859328 00000100:00100000:3.0:1787759199.612139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1787759199.612147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+13:9840:x1874601281859328:12345-192.168.204.38@tcp:37:rm.0 00000100:00100000:3.0:1787759199.614938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+13:9840:x1874601281859328:12345-192.168.204.38@tcp:37:rm.0 Request processed in 2784us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.614949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:0.0:1787759199.617098:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.617745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281859584 00000100:00100000:1.0:1787759199.617754:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281859584 00000100:00100000:1.0:1787759199.617802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:1.0:1787759199.617812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+13:9840:x1874601281859584:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:1.0:1787759199.618029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+14:9840:x1874601281859584:12345-192.168.204.38@tcp:35:rm.0 Request processed in 217us (935us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787759199.618037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:0.0:1787759199.619493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.619577:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281859840 00000100:00100000:3.0:1787759199.619583:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281859840 00000100:00100000:1.0:1787759199.619693:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:1.0:1787759199.619705:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+14:9840:x1874601281859840:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1787759199.619723:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.619741:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf757 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f7635096 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.619827:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf75e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.619842:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf75e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.619852:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf75e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.619862:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787759199.619961:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf757 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635096 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.619976:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf75e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635096 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.619984:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:1.0:1787759199.619987:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787759199.619991:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d972c00, rc 0) 00000100:00100000:1.0:1787759199.620034:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281859840:12345-192.168.204.38@tcp:101:rm.0 Request processed in 332us (543us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787759199.620041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 22 00000100:00100000:0.0:1787759199.623433:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.623628:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281859968 00000100:00100000:2.0:1787759199.623638:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281859968 00000100:00100000:2.0:1787759199.623733:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:2.0:1787759199.623744:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281859968:12345-192.168.204.38@tcp:41:rm.0 00000004:00000024:2.0:1787759199.623804:0:6792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787759199.623870:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281859968:12345-192.168.204.38@tcp:41:rm.0 Request processed in 127us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759199.623877:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:0.0:1787759199.625581:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.625726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281860096 00000100:00100000:3.0:1787759199.625735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281860096 00000100:00100000:3.0:1787759199.625799:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:3.0:1787759199.625809:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281860096:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:3.0:1787759199.625825:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787759199.625843:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf76c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f763509d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625898:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625925:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625937:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625952:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625969:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.625976:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626111:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626120:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626127:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787759199.626151:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787759199.626155:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787759199.626168:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626180:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626197:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626203:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626210:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626215:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166ec00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.626219:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626226:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626238:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:3.0:1787759199.626240:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.626245:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626252:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ec00/0x662cc405a6abf773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626264:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626270:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626276:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626285:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e800 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.626287:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626294:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626300:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8d775b85d800) 00010000:00010000:3.0:1787759199.626302:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.626305:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626310:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e800/0x662cc405a6abf77a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626347:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e400/0x662cc405a6abf76c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763509d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626361:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763509d expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.626531:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d775923d800) 00010000:00010000:3.0:1787759199.626534:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787759199.626537:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d776d9b4800, rc 0) 00000100:00100000:3.0:1787759199.626631:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+17:9840:x1874601281860096:12345-192.168.204.38@tcp:101:rm.0 Request processed in 824us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.626639:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 24 00000100:00100000:0.0:1787759199.629136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.629251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281860352 00000100:00100000:1.0:1787759199.629269:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281860352 00000100:00100000:1.0:1787759199.629326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 25 00000100:00100000:1.0:1787759199.629336:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+17:9840:x1874601281860352:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1787759199.629711:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787759199.629738:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4800/0x662cc405a6abf781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763509d expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629759:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81600/0x662cc405a6abf72d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635081 expref: 16 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629769:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d775923d800) 00010000:00010000:1.0:1787759199.629790:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166ea00/0x662cc405a6abf742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635088 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629798:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:1.0:1787759199.629802:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759199.629821:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629833:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629841:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629856:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629863:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629879:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.629993:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630000:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630007:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787759199.630755:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787759199.630767:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 163871399785ns, next at 164871397379ns, rc = 0 00010000:00010000:1.0:1787759199.630821:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630829:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630836:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630843:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630849:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630855:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630888:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787759199.630907:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630913:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630919:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630925:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972800 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.630934:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630941:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630950:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7750ca3900) 00010000:00010000:1.0:1787759199.630953:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787759199.630956:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630963:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972800/0x662cc405a6abf796 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630977:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630983:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.630989:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.631001:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972a00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.631004:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.631010:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.631018:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:1.0:1787759199.631021:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.631023:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.631028:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972a00/0x662cc405a6abf788 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759199.631038:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8c3130d reply state 00000000428f3f70 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.631045:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787759199.631120:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281860352:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1783us (1990us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787759199.631127:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 25 00010000:00010000:3.0:1787759199.631149:0:11282:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759199.631170:0:11282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.631179:0:11282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973000 already unused, calling callback (ffffffffc144d530) 00010000:00010000:3.0:1787759199.631183:0:11282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.631191:0:11282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.631203:0:11282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d7750ca3900) 00010000:00010000:3.0:1787759199.631206:0:11282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787759199.631209:0:11282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.631215:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973000/0x662cc405a6abf79d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.631233:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759199.631235:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759199.631237:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759199.632418:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632433:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632441:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632446:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973400 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.632449:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632462:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632471:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7c3c31ce (ffff8d7750ca3b00) 00010000:00010000:3.0:1787759199.632473:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.632476:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.632480:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973400/0x662cc405a6abf78f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7c3c31ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.633654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.633788:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281860608 00000100:00100000:3.0:1787759199.633796:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281860608 00000100:00100000:3.0:1787759199.633831:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:3.0:1787759199.633837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7744a49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+15:9840:x1874601281860608:12345-192.168.204.38@tcp:35:rm.0 00000100:00100000:3.0:1787759199.634033:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7744a49850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281860608:12345-192.168.204.38@tcp:35:rm.0 Request processed in 194us (383us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787759199.634041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1787759199.635204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.635248:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281860864 00000100:00100000:1.0:1787759199.635254:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281860864 00000100:00100000:1.0:1787759199.635302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00000100:00100000:1.0:1787759199.635310:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+16:9840:x1874601281860864:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:1.0:1787759199.635347:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787759199.635398:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf75e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635096 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635452:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d774166e200/0x662cc405a6abf6fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635073 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635464:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d775b85d200) 00010000:00010000:1.0:1787759199.635484:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7782175600/0x662cc405a6abf6bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635065 expref: 14 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3000) 00010000:00010000:1.0:1787759199.635500:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759199.635530:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635546:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635555:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635565:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635571:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635582:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635914:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635941:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.635956:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.636835:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787759199.636850:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636864:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636870:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636876:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973e00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.636885:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636893:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636903:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d7750ca3d00) 00010000:00010000:1.0:1787759199.636906:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787759199.636909:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636922:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636939:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636952:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636958:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636964:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972e00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759199.636967:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636973:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.636989:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3600) 00010000:00010000:1.0:1787759199.636992:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759199.636996:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.637001:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759199.637020:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6c7d229 reply state 000000003d4ea524 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.637029:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787759199.637121:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+15:9840:x1874601281860864:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1809us (1917us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787759199.637130:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 26 00010000:00010000:3.0:1787759199.638310:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638327:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638333:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638337:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973a00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759199.638347:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638361:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638417:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d7750ca3500) 00010000:00010000:3.0:1787759199.638420:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787759199.638425:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759199.638433:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973a00/0x662cc405a6abf7ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.651271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759199.651348:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281860992 00000100:00100000:2.0:1787759199.651357:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281860992 00000100:00100000:2.0:1787759199.651486:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:2.0:1787759199.651497:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+14:9843:x1874601281860992:12345-192.168.204.38@tcp:101:getfattr.0 00010000:00010000:2.0:1787759199.651521:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787759199.651542:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f76350a4 expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651621:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651637:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651649:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787759199.651725:0:6792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787759199.651729:0:6792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787759199.651772:0:6792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651796:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a80600/0x662cc405a6abf7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350a4 expref: 16 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651815:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350a4 expref: 15 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.651824:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775923d500) 00010000:00010000:2.0:1787759199.651827:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787759199.651830:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d7750a81400, rc 0) 00000100:00100000:2.0:1787759199.651905:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+15:9843:x1874601281860992:12345-192.168.204.38@tcp:101:getfattr.0 Request processed in 410us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759199.651912:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00000100:00100000:0.0:1787759199.654856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759199.654943:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861120 00000100:00100000:3.0:1787759199.654952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861120 00000100:00100000:3.0:1787759199.655000:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:3.0:1787759199.655010:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+15:9843:x1874601281861120:12345-192.168.204.38@tcp:33:getfattr.0 00000004:00200000:3.0:1787759199.655099:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787759199.655104:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:3.0:1787759199.655275:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e27cd7ed-1056-4119-a592-11d825b15827+15:9843:x1874601281861120:12345-192.168.204.38@tcp:33:getfattr.0 Request processed in 266us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759199.655283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 5 00000100:00100000:0.0:1787759199.686722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.686839:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861376 00000100:00100000:1.0:1787759199.686848:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861376 00000100:00100000:1.0:1787759199.686913:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00000100:00100000:1.0:1787759199.686924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+15:9848:x1874601281861376:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1787759199.686984:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759199.687011:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d7750a81400/0x662cc405a6abf7c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350a4 expref: 15 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.687031:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775923d500) 00010000:00010000:1.0:1787759199.687043:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759199.687068:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.687081:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.687090:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787759199.687332:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bff8c62b reply state 0000000046dad90a transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759199.687343:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787759199.687575:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787759199.687864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+16:9848:x1874601281861376:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 939us (1149us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787759199.687872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00010000:00010000:2.0:1787759199.689912:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689925:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689933:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689940:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972e00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:2.0:1787759199.689945:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689965:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689980:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3600) 00010000:00010000:2.0:1787759199.689983:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787759199.689987:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759199.689994:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972e00/0x662cc405a6abf7c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759199.697457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.697547:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861504 00000100:00100000:1.0:1787759199.697562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861504 00000100:00100000:1.0:1787759199.697653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:1.0:1787759199.697664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+15:9849:x1874601281861504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1787759199.697692:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759199.697716:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f76350ab expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.697811:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.697825:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.697837:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787759199.698005:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787759199.698010:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787759199.698040:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.698065:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973e00/0x662cc405a6abf7ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350ab expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.698084:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350ab expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759199.698092:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3d00) 00010000:00010000:1.0:1787759199.698095:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787759199.698099:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d972c00, rc 0) 00000100:00100000:1.0:1787759199.698164:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:9849:x1874601281861504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 502us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.698172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00000100:00100000:0.0:1787759199.700675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759199.702108:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861632 00000100:00100000:1.0:1787759199.702118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861632 00000100:00100000:1.0:1787759199.702189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:1.0:1787759199.702198:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:9849:x1874601281861632:12345-192.168.204.38@tcp:33:lfs.0 00000004:00200000:1.0:1787759199.702282:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787759199.702288:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00100000:1.0:1787759199.702361:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:9849:x1874601281861632:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 159us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759199.702394:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 6 00000100:00100000:2.0:1787759200.078902:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759200.078927:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d77484443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293421824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787759200.078996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759200.079043:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421824 00000100:00100000:3.0:1787759200.079052:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421824 00000100:00100000:3.0:1787759200.079145:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787759200.079158:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293421824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787759200.079192:0:6684:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787759200.079234:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293421824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759200.079254:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787759200.079273:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d77484443c0 x1874601293421824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759200.079291:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d77484443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293421824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787759200.398523:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787759200.465093:0:11630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-compr test 1030: Migrate to another compression level ========================================================== 11:46:39 (1787759199) 00000001:02000400:2.0:1787759201.089190:0:11678:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-compr test_1030 bunzip2 is not installed 00010000:00010000:2.0:1787759201.422635:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759201.597112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759201.597190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1787759201.597247:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759201.597489:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861760 00000100:00100000:2.0:1787759201.597499:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281861888 00000100:00100000:1.0:1787759201.597502:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861760 00000100:00100000:2.0:1787759201.597509:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281861888 00000100:00080000:0.0:1787759201.597567:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787759201.597597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:1.0:1787759201.597618:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281861760:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759201.597622:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:2.0:1787759201.597639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77758c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+16:2382:x1874601281861888:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1787759201.597723:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77758c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+16:2382:x1874601281861888:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 84us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.597727:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2381:x1874601281861760:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 110us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759201.597761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 44 00000100:00100000:1.0:1787759201.597765:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 208 00000100:00100000:1.0:1787759201.597829:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862016 00000100:00100000:1.0:1787759201.597836:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862016 00000100:00080000:2.0:1787759201.597883:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787759201.597898:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 23 00000100:00100000:1.0:1787759201.597913:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d777c730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281862016:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:1.0:1787759201.597971:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d777c730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e27cd7ed-1056-4119-a592-11d825b15827+5:2381:x1874601281862016:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 63us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759201.597984:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 23 00000001:02000400:0.0:1787759201.751063:0:11726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-compr test complete, duration 24 sec =========== 11:46:41 (1787759201) 00000001:02000400:1.0:1787759202.421144:0:11774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: start cleanup 11:46:41 (1787759201) === 00010000:00010000:1.0:1787759202.446466:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759202.463084:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759202.463170:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862144 00000100:00100000:1.0:1787759202.463181:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862144 00000100:00100000:1.0:1787759202.463240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:1.0:1787759202.463262:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7751986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:7642:x1874601281862144:12345-192.168.204.38@tcp:37:bash.0 00000100:00100000:1.0:1787759202.467858:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7751986d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:7642:x1874601281862144:12345-192.168.204.38@tcp:37:bash.0 Request processed in 4589us (4772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759202.467873:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 7 00000100:00100000:0.0:1787759202.476691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759202.476765:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862272 00000100:00100000:1.0:1787759202.476777:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862272 00000100:00100000:1.0:1787759202.476845:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30 00000100:00100000:1.0:1787759202.476855:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+16:10447:x1874601281862272:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:1.0:1787759202.476877:0:6792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787759202.476898:0:6792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973c00/0x662cc405a6abf7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f76350b2 expref: -99 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.476972:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.476998:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477011:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477045:0:6792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477054:0:6792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477061:0:6792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477141:0:6792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477149:0:6792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477156:0:6792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477163:0:6792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d972000 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759202.477168:0:6792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477176:0:6792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477190:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3d00) 00010000:00010000:1.0:1787759202.477193:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759202.477198:0:6792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477205:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972000/0x662cc405a6abf7e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477217:0:6792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477225:0:6792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477232:0:6792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477243:0:6792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d777d973800 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:1.0:1787759202.477246:0:6792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477253:0:6792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477262:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff8d7750ca3f00) 00010000:00010000:1.0:1787759202.477265:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759202.477268:0:6792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477274:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973800/0x662cc405a6abf7ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477305:0:6792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973c00/0x662cc405a6abf7dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350b2 expref: 17 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477316:0:6792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3d00) 00010000:00010000:1.0:1787759202.477318:0:6792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787759202.477322:0:6792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d973c00/0x662cc405a6abf7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350b2 expref: 17 pid: 6792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759202.477333:0:6792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d777d973c00, rc 0) 00000100:00100000:1.0:1787759202.477419:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d8c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e27cd7ed-1056-4119-a592-11d825b15827+16:10447:x1874601281862272:12345-192.168.204.38@tcp:101:rm.0 Request processed in 564us (741us total) trans 0 rc 301/301 00000100:00100000:1.0:1787759202.477428:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30 00010000:00010000:2.0:1787759203.470644:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787759203.676460:0:11871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-compr: finish cleanup 11:46:43 (1787759203) === 00000100:00100000:2.0:1787759203.724085:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759203.724124:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862528 00000100:00100000:3.0:1787759203.724145:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862528 00000100:00080000:2.0:1787759203.724214:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787759203.724245:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31 00000100:00100000:3.0:1787759203.724259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+16:10728:x1874601281862528:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1787759203.724347:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759203.724405:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d777d972c00/0x662cc405a6abf7d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350ab expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.724423:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7750ca3d00) 00010000:00010000:3.0:1787759203.724435:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759203.724460:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.724471:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.724479:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787759203.724738:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092099aa3 reply state 000000003b8fc016 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759203.724749:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787759203.724766:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787759203.724853:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e385680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e27cd7ed-1056-4119-a592-11d825b15827+17:10728:x1874601281862528:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 598us (777us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787759203.724871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31 00010000:00010000:3.0:1787759203.725806:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725817:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725824:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725830:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d776d9b4e00 already unused, calling callback (ffffffffc1e6c4f0) 00010000:00010000:3.0:1787759203.725840:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725847:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725859:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d775b85d100) 00010000:00010000:3.0:1787759203.725861:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787759203.725866:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759203.725872:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d776d9b4e00/0x662cc405a6abf7f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759203.842757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759203.842825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862656 00000100:00100000:0.0:1787759203.842973:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862656 00000100:00100000:0.0:1787759203.843046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:0.0:1787759203.843068:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+16:10751:x1874601281862656:12345-192.168.204.38@tcp:101:lsof.0 00010000:00010000:0.0:1787759203.843092:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787759203.843113:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2000/0x662cc405a6abf7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x114de731f76350b9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843172:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843199:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787759203.843263:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787759203.843268:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787759203.843312:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843349:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e2000/0x662cc405a6abf7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350b9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843469:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350b9 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759203.843479:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7743c92500) 00010000:00010000:0.0:1787759203.843482:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787759203.843486:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d77609e3c00, rc 0) 00000100:00100000:0.0:1787759203.843569:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e385e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e27cd7ed-1056-4119-a592-11d825b15827+17:10751:x1874601281862656:12345-192.168.204.38@tcp:101:lsof.0 Request processed in 503us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759203.843578:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 32 00000100:00100000:2.0:1787759204.128278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1787759204.128408:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862784 00000100:00100000:3.0:1787759204.128420:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862784 00000100:00100000:3.0:1787759204.128493:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:3.0:1787759204.128504:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+10:2384:x1874601281862784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787759204.128520:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759204.128622:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281862912 00000100:00100000:1.0:1787759204.128639:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281862912 00000100:00100000:1.0:1787759204.128687:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 3 00010000:00010000:3.0:1787759204.128697:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787759204.128698:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+11:2384:x1874601281862912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787759204.128709:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787759204.128732:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174e00/0x662cc405a6abf68c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635057 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.128732:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80c00/0x662cc405a6abf5b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635042 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759204.128757:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787759204.128760:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759204.128811:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:2384:x1874601281862784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 309us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.128818:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+9:2384:x1874601281862912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759204.128822:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2 00000100:00100000:1.0:1787759204.128832:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 3 00000100:00100000:2.0:1787759204.129423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759204.129498:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281863040 00000100:00100000:0.0:1787759204.129563:0:5866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281863040 00000100:00100000:0.0:1787759204.129601:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:0.0:1787759204.129611:0:5866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e3843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+8:2383:x1874601281863040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787759204.129621:0:5866:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759204.129631:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7740031600/0x662cc405a6abf57b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f763500a expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.129642:0:5866:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787759204.129668:0:5866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e3843c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+7:2383:x1874601281863040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759204.129674:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 4 00000100:00100000:2.0:1787759204.130081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759204.130226:0:8770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281863168 00000100:00100000:1.0:1787759204.130232:0:8770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281863168 00000100:00100000:1.0:1787759204.130316:0:8770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:1.0:1787759204.130324:0:8770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e27cd7ed-1056-4119-a592-11d825b15827+5:2380:x1874601281863168:12345-192.168.204.38@tcp:9:umount.0 00000020:00000080:1.0:1787759204.130347:0:8770:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf734 00000100:00080000:1.0:1787759204.130356:0:8770:0:(import.c:65:import_set_state_nolock()) ffff8d7747b7b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787759204.130413:0:8770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1787759204.130416:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787759204.130530:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787759204.130702:0:8770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e384780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e27cd7ed-1056-4119-a592-11d825b15827+2:2380:x1874601281863168:12345-192.168.204.38@tcp:9:umount.0 Request processed in 377us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.130709:0:8770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 14 00000100:00100000:2.0:1787759204.133937:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1787759204.134051:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281863424 00000100:00100000:1.0:1787759204.134058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281863424 00000100:00100000:1.0:1787759204.134102:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 33 00000100:00100000:1.0:1787759204.134109:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+17:2380:x1874601281863424:12345-192.168.204.38@tcp:39:umount.0 00000020:00000080:1.0:1787759204.134139:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf589 00000020:00010000:1.0:1787759204.134145:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d7642861000: total 0 00000100:00080000:1.0:1787759204.134157:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d7642866800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787759204.134218:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967310 00000020:00010000:2.0:1787759204.134602:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d7642861000: total 0 00000100:00100000:1.0:1787759204.134627:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e387c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e27cd7ed-1056-4119-a592-11d825b15827+16:2380:x1874601281863424:12345-192.168.204.38@tcp:39:umount.0 Request processed in 517us (697us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787759204.134635:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 33 00010000:00010000:2.0:1787759204.134647:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d7642861000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787759204.134679:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d7743c92500) 00010000:00010000:2.0:1787759204.134683:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787759204.134692:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d77609e3c00/0x662cc405a6abf7ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0x114de731f76350b9 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.134713:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d7642861000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787759204.134733:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759204.134736:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759204.134739:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759204.144691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1787759204.144836:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601281863680 00000100:00100000:0.0:1787759204.144863:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601281863680 00000100:00100000:2.0:1787759204.144986:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 209 00000100:00100000:2.0:1787759204.145001:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+7:2380:x1874601281863680:12345-192.168.204.38@tcp:251:umount.0 00000020:00000080:2.0:1787759204.145079:0:5829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf566 00000020:00010000:2.0:1787759204.145089:0:5829:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d7772198000: total 0 00000100:00080000:2.0:1787759204.145097:0:5829:0:(import.c:65:import_set_state_nolock()) ffff8d777219b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787759204.145196:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2f3fdd18-fa03-418f-9660-ec3aa1731f1a+3:2380:x1874601281863680:12345-192.168.204.38@tcp:251:umount.0 Request processed in 200us (522us total) trans 0 rc 0/0 00000020:00010000:1.0:1787759204.145197:0:5823:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d7772198000: total 0 00000100:00100000:2.0:1787759204.145205:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 209 00010000:00010000:1.0:1787759204.145271:0:5823:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d7772198000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787759204.145319:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175800/0x662cc405a6abf5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0x114de731f7635049 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759204.145336:0:5823:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d7772198000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787759204.145350:0:5823:0:(genops.c:885:class_export_put()) final put ffff8d7772198000/2f3fdd18-fa03-418f-9660-ec3aa1731f1a 00010000:00010000:1.0:1787759204.145417:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787759204.145420:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7772198000/2f3fdd18-fa03-418f-9660-ec3aa1731f1a for MGS 00010000:00010000:1.0:1787759204.145421:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759204.145423:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787759204.145475:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d777219b000 for MGS 00000004:00080000:1.0:1787759204.174971:0:6791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 168415600992ns, next at 169415598449ns, rc = 0 00000100:00100000:2.0:1787759204.175080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293421952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787759204.175183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759204.175441:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293421952 00000100:00100000:0.0:1787759204.175452:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293421952 00000100:00100000:0.0:1787759204.175573:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787759204.175587:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293421952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787759204.175645:0:6683:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787759204.175706:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e384f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874601293421952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759204.175714:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787759204.175747:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787759204.175774:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d84d680 x1874601293421952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787759220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759204.175799:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874601293421952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787759204.494497:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759204.686655:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787759204.686693:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e3870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293422080:0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.686785:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787759204.686810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759204.686826:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293422592:0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.686938:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759204.686988:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293422208:0@lo:400:kworker.0 00000100:00100000:3.0:1787759204.687012:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293422336:0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759204.687068:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422080 00000100:00100000:3.0:1787759204.687075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759204.687080:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422080 00000100:00100000:1.0:1787759204.687099:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601293422464:0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759204.687163:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422592 00000100:00100000:2.0:1787759204.687172:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1787759204.687174:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422592 00000100:00100000:2.0:1787759204.687207:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293422080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687228:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422208 00000100:00100000:1.0:1787759204.687235:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422208 00000100:00100000:3.0:1787759204.687279:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787759204.687296:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293422592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687298:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422336 00000100:00100000:1.0:1787759204.687310:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422336 00000100:00100000:2.0:1787759204.687310:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7750b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3304:x1874601293422080:12345-0@lo:400:kworker.0 Request processed in 115us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759204.687323:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787759204.687345:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422464 00000100:00100000:1.0:1787759204.687351:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422464 00000100:00100000:3.0:1787759204.687430:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293422592:12345-0@lo:400:kworker.0 Request processed in 138us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.687432:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787759204.687451:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787759204.687458:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293422208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687533:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874601293422208:12345-0@lo:400:kworker.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.687546:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787759204.687565:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787759204.687573:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d7748445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293422336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687614:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d7748445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874601293422336:12345-0@lo:400:kworker.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.687620:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787759204.687635:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787759204.687641:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601293422464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.687678:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874601293422464:12345-0@lo:400:kworker.0 Request processed in 38us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.687684:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787759204.687758:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787759204.687765:0:5831:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787759204.687819:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e3852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874601293422336:0@lo:400:kworker.0 00000100:00100000:3.0:1787759204.687872:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e3870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3304:1874601293422080:0@lo:400:kworker.0 00010000:00080000:3.0:1787759204.687926:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776e384b40 x1874601293422592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759204.687939:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e384b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293422592:0@lo:400:kworker.0 00000100:00100000:3.0:1787759204.687976:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e386940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874601293422208:0@lo:400:kworker.0 00000100:00100000:1.0:1787759204.688184:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e386580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601293422464:0@lo:400:kworker.0 00000004:00080000:0.0:1787759204.710209:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00100000:0.0:1787759204.710227:0:5857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000001:00080000:0.0:1787759204.710237:0:5857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967311 is committed 00000004:00080000:0.0:1787759204.710251:0:5857:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00000080:0.0:1787759204.710290:0:5857:0:(genops.c:885:class_export_put()) final put ffff8d7642861000/e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:2.0:1787759204.710316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7642861000/e27cd7ed-1056-4119-a592-11d825b15827 for lustre-MDT0000 00000100:00100000:3.0:1787759204.710346:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00000080:2.0:1787759204.710403:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7642866800 for lustre-MDT0000 00000100:00100000:3.0:1787759204.710418:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d7751984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293422720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787759204.710485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759204.710543:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422720 00000100:00100000:2.0:1787759204.710550:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422720 00000100:00100000:2.0:1787759204.710604:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787759204.710616:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874601293422720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787759204.710643:0:6682:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787759204.710682:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f0a5f, atime: 0x6a8f0a5f, ctime: 0x6a8f0a5f, blocks: 0x1 00010000:00010000:2.0:1787759204.710704:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.710728:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=168s v=(0 0) 00010000:00010000:2.0:1787759204.710734:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787759204.710741:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.710761:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.710771:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.710780:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.710801:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787759204.710810:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759204.710820:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.710833:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a81600 already unused, calling callback (ffffffffc144d530) 00010000:00010000:0.0:1787759204.710840:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.710851:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.710876:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.710900:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a81e27d/0x662cc405a6abf806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.710924:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759204.710927:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759204.710929:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759204.711561:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775aea0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874601293422720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 946us (1074us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787759204.711572:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787759204.711588:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d7751984b40/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787759204.711597:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d7751984b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874601293422720:0@lo:6:osp-syn-0-0.0 00000001:00100000:0.0:1787759204.712820:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:0.0:1787759204.712826:0:6705:0:(genops.c:885:class_export_put()) final put ffff8d7747b7c000/e27cd7ed-1056-4119-a592-11d825b15827 00000020:00000080:2.0:1787759204.712850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7747b7c000/e27cd7ed-1056-4119-a592-11d825b15827 for lustre-OST0000 00000020:00000080:2.0:1787759204.712894:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7747b7b000 for lustre-OST0000 00000020:01000004:0.0:1787759204.873539:0:11970:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787759204.880556:0:11970:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787759204.880604:0:11970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.880615:0:11970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.880620:0:11970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.880625:0:11970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.880638:0:11970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787759204.880643:0:11970:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787759204.880662:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1787759204.880667:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787759204.880670:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759204.880672:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787759204.880677:0:11970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787759204.880677:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782174000 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:2.0:1787759204.880691:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.880699:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787759204.880702:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d774644d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:2.0:1787759204.880708:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759204.880713:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787759204.880715:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787759204.880718:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787759204.880745:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.880751:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787759204.880758:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293422848:0@lo:39:umount.0 00010000:00010000:2.0:1787759204.880777:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.880784:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7782174000/0x662cc405a6abf5f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf600 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.880794:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759204.880796:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759204.880798:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759204.880818:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293422976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787759204.880836:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759204.880860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787759204.880918:0:6792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422848 00000100:00100000:2.0:1787759204.880926:0:6792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422848 00000100:00100000:3.0:1787759204.880929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293422976 00000100:00100000:3.0:1787759204.880935:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293422976 00000100:00100000:3.0:1787759204.880991:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787759204.881007:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776dc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+19:3305:x1874601293422976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759204.881013:0:6792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787759204.881021:0:6792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874601293422848:12345-0@lo:39:umount.0 00010000:00010000:3.0:1787759204.881022:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759204.881040:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80a00/0x662cc405a6abf600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf5f9 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787759204.881044:0:6792:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf38a 00000100:00080000:2.0:1787759204.881051:0:6792:0:(import.c:65:import_set_state_nolock()) ffff8d777c9c8800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787759204.881056:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759204.881085:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787759204.881107:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776dc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+18:3305:x1874601293422976:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759204.881116:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787759204.881122:0:6792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1874601293422848:12345-0@lo:39:umount.0 Request processed in 100us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759204.881129:0:6792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787759204.881135:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d774644d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1787759204.881139:0:6792:0:(genops.c:885:class_export_put()) final put ffff8d777c9ce000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1787759204.881146:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874601293422848:0@lo:39:umount.0 00000100:00100000:3.0:1787759204.881158:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e386d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3305:1874601293422976:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787759204.881188:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:3.0:1787759204.881190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777c9ce000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1787759204.881192:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787759204.881198:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787759204.881242:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d777c9c8800 for lustre-MDT0000 00010000:00010000:0.0:1787759204.882147:0:11970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882158:0:11970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882163:0:11970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882170:0:11970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882191:0:11970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787759204.882196:0:11970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882203:0:11970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882209:0:11970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882214:0:11970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882236:0:11970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787759204.882239:0:11282:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759204.882243:0:11970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882248:0:11282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882266:0:11282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a80400 already unused, calling callback (ffffffffc1a48c20) 00010000:00010000:0.0:1787759204.882270:0:11970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759204.882271:0:11282:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882287:0:11970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882291:0:11282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882300:0:11970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787759204.882306:0:11282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787759204.882314:0:11282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787759204.882316:0:11282:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787759204.882320:0:11970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787759204.882328:0:11970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882336:0:11970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882338:0:11282:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.882342:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787759204.882348:0:11970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.882350:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882353:0:11282:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759204.882386:0:11970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759204.882401:0:11970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787759204.882406:0:11970:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787759204.882412:0:11970:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1787759204.882412:0:11282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882421:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a80400/0x662cc405a6abf607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf60e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882436:0:11282:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:0.0:1787759204.882443:0:11970:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1787759204.882447:0:11282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1787759204.882448:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787759204.882456:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1787759204.882458:0:11282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:2.0:1787759204.882463:0:11282:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787759204.882465:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00010000:00010000:2.0:1787759204.882472:0:11282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787759204.882480:0:11970:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d7747b78800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1787759204.882483:0:11282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787759204.882507:0:11970:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d7641c77000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1787759204.882512:0:11282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00080000:0.0:1787759204.882516:0:11970:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d7746459a48) has exports, disconnecting them 10000000:01000000:2.0:1787759204.882517:0:11282:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787759204.882522:0:11282:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787759204.882524:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782174800 already unused, calling callback (ffffffffc1a48c20) 00000020:00080000:0.0:1787759204.882526:0:11970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d7747b78800), last request at 1787759204 00010000:00010000:1.0:1787759204.882527:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1787759204.882531:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759204.882534:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787759204.882535:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf4e8 00010000:00010000:2.0:1787759204.882541:0:11282:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.882543:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787759204.882545:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d7747b7f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787759204.882545:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77413fde00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:1.0:1787759204.882552:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787759204.882561:0:11970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7747b78800): rc 0 00010000:00010000:2.0:1787759204.882564:0:11282:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1787759204.882564:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787759204.882568:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7747b78800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1787759204.882568:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759204.882575:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00010000:1.0:1787759204.882577:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759204.882578:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787759204.882580:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:1.0:1787759204.882582:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787759204.882584:0:7620:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000020:00080000:0.0:1787759204.882588:0:11970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d7641c77000), last request at 1787759204 10000000:01000000:1.0:1787759204.882588:0:7620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787759204.882593:0:11282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787759204.882596:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf40f 00010000:00010000:1.0:1787759204.882602:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.882602:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882605:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7782175200/0x662cc405a6abf67e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf685 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787759204.882606:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d7641c70000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787759204.882617:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787759204.882617:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:0.0:1787759204.882618:0:11970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7641c77000): rc 0 00000020:00000080:0.0:1787759204.882625:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7641c77000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1787759204.882628:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759204.882630:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759204.882630:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787759204.882635:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:0.0:1787759204.882638:0:11970:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f6742bb7ae0 00010000:00010000:2.0:1787759204.882639:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759204.882640:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d77413fde00/0x662cc405a6abf2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf2e9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.882640:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7782174800/0x662cc405a6abf520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf527 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759204.882656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e3861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293423104:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787759204.882659:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759204.882659:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787759204.882660:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1787759204.882664:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759204.882664:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759204.882665:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1787759204.882667:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759204.882668:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759204.882675:0:11970:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d7751984b40 x1874601293422720/t4294967300(4294967300) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787759220 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759204.882683:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423232:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1787759204.882687:0:11970:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d7751984b40, transno 4294967300 00000100:00100000:2.0:1787759204.882708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787759204.882712:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787759204.882720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759204.882758:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787759204.882772:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787759204.882774:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423232 00000100:00080000:0.0:1787759204.882781:0:11970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787759204.882783:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423232 00000100:00080000:0.0:1787759204.882796:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d7747b78000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787759204.882800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787759204.882813:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787759204.882824:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776dc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759204.882845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787759204.882888:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1787759204.882901:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787759204.882958:0:11970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787759204.882968:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d777219c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787759204.882997:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d7746459a48) has no exports 00000100:00100000:1.0:1787759204.882999:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423488 00000100:00100000:1.0:1787759204.883005:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423488 00000100:00100000:1.0:1787759204.883037:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423360 00000100:00100000:1.0:1787759204.883040:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423360 00000100:00100000:3.0:1787759204.883042:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787759204.883051:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775afc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3303:x1874601293423232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787759204.883056:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787759204.883060:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787759204.883068:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775afc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3303:x1874601293423488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787759204.883070:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787759204.883074:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81000/0x662cc405a6abf685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf67e expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759204.883082:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d775af07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+20:3303:x1874601293423360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787759204.883084:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759204.883086:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759204.883090:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787759204.883098:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174a00/0x662cc405a6abf2e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf2e2 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759204.883102:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80e00/0x662cc405a6abf527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf520 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787759204.883116:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775afc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+17:3303:x1874601293423232:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (397us total) trans 0 rc 0/0 00010000:00010000:0.0:1787759204.883121:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787759204.883124:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787759204.883124:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:3.0:1787759204.883148:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7747b78800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1787759204.883166:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775afc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3303:x1874601293423488:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787759204.883168:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d775af07c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+16:3303:x1874601293423360:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787759204.883180:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000020:00000080:3.0:1787759204.883183:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641c77000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1787759204.883192:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:3.0:1787759204.883210:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7747b7f800 for lustre-MDT0000 00000020:00000080:3.0:1787759204.883214:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7641c70000 for lustre-MDT0000 00000100:00100000:3.0:1787759204.883238:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759204.883247:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776dc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787759204.883253:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3303:1874601293423232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787759204.883284:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759204.883292:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293423616:0@lo:9:umount.0 00000100:00100000:1.0:1787759204.883321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759204.883486:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293423744:0@lo:9:umount.0 00000100:00100000:1.0:1787759204.883523:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787759204.883588:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423616 00000100:00100000:3.0:1787759204.883593:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423616 00000100:00100000:2.0:1787759204.883595:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423744 00000100:00100000:2.0:1787759204.883602:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423744 00000020:00080000:0.0:1787759204.883604:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d7746459a48) has no exports 00000100:00100000:3.0:1787759204.883637:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787759204.883645:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759204.883650:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874601293423616:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787759204.883655:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787759204.883661:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776d84e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874601293423744:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787759204.883666:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00000080:2.0:1787759204.883691:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf558 00000020:00000080:3.0:1787759204.883691:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf45c 00000100:00080000:2.0:1787759204.883702:0:6681:0:(import.c:65:import_set_state_nolock()) ffff8d7642862000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787759204.883714:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d7641c86000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787759204.883738:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1787759204.883751:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787759204.883753:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787759204.884020:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+3:3302:x1874601293423616:12345-0@lo:9:umount.0 Request processed in 373us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759204.884040:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787759204.884046:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d7747b78000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787759204.884056:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787759204.884058:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787759204.884061:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293423616:0@lo:9:umount.0 00000100:00100000:3.0:1787759204.884063:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293423104 00000100:00100000:3.0:1787759204.884067:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293423104 00000100:00100000:3.0:1787759204.884096:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787759204.884104:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d77485d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+15:3306:x1874601293423104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787759204.884112:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787759204.884124:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166f800/0x662cc405a6abf60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf607 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.884136:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787759204.884160:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776d84e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1874601293423744:12345-0@lo:9:umount.0 Request processed in 503us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787759204.884169:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787759204.884176:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d77485d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6+14:3306:x1874601293423104:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787759204.884184:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1787759204.884188:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1787759204.884221:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d776d8c2d00 x1874601293423744/t0(0) o9->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787759214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787759204.884235:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e3861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293423104:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787759204.884242:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777219c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787759204.884259:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787759204.884261:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787759204.884272:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874601293423744:0@lo:9:umount.0 00000020:00000080:0.0:1787759204.911322:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf33d 00000020:00000080:0.0:1787759204.911336:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d77485ce000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787759204.911357:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787759204.911385:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787759204.911395:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787759204.911400:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d7747af4ed8) has no exports 00000020:00000080:1.0:1787759204.911444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77485ce000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787759204.911632:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf336 00000020:00000080:0.0:1787759204.911638:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777d81b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787759204.911699:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787759204.911706:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787759204.911708:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777d811800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787759204.911710:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777d811800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787759204.911718:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777d81b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787759204.911721:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1787759204.911817:0:11970:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d777c88aa80 - data ffff8d7777c5a798/ffff8d7641e3f800 00000020:01000000:0.0:1787759204.911920:0:11970:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d774515d000 - data ffff8d774fae0af8/ffff8d777c990000 00000001:00000004:2.0:1787759204.924708:0:11970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1787759204.957226:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787759204.957235:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787759204.957248:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787759204.957251:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787759204.957650:0:6790:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787759204.957656:0:6790:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 2 count 2 00000040:00080000:0.0:1787759204.957665:0:6790:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787759204.957852:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787759204.957856:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787759204.957917:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787759204.957920:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787759204.958117:0:8139:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787759204.958122:0:8139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787759204.958130:0:8139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787759204.976838:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf305 00000020:00000080:2.0:1787759204.976865:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777cf49800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787759204.976888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf49800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787759204.978071:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf31a 00000020:00000080:2.0:1787759204.978078:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777cf4c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787759204.978086:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787759204.978097:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.978106:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787759204.978111:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d774645ced8) has no exports 00000020:00000080:1.0:1787759204.978117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf4c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787759204.978261:0:11970:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787759204.978277:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf54a 00000020:00000080:2.0:1787759204.978283:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d77537d1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787759204.978298:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787759204.978301:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.978306:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787759204.978307:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d7747d19a48) has no exports 00000020:00000080:2.0:1787759204.978315:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf543 00000020:00000080:2.0:1787759204.978317:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777219d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787759204.978389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77537d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787759204.978398:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777219d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787759204.978796:0:11970:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787759204.978801:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787759204.978806:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787759204.978811:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787759204.978814:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787759204.978872:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.978880:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759204.978886:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf455 00000020:00000080:2.0:1787759204.978892:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7641e56000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787759204.978896:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787759204.978899:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.978902:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787759204.978905:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d7641a6b490) has no exports 00000020:00000080:2.0:1787759204.978908:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf44e 00000020:00000080:2.0:1787759204.978911:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777c0ed000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787759204.978922:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d777219c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787759204.978931:0:36:0:(genops.c:885:class_export_put()) final put ffff8d7641cc8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787759204.978933:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641cc8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787759204.978940:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787759204.979032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641e56000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787759204.979043:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777c0ed000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787759204.979243:0:11970:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787759204.979246:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787759204.979247:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1787759204.979250:0:11970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787759204.979251:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787759204.979273:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.979276:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759204.979295:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.979297:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759204.979304:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7743841000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787759204.979306:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7743841000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787759204.979313:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7747b78000 for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787759204.979315:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787759204.979322:0:36:0:(genops.c:885:class_export_put()) final put ffff8d777c9cd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787759204.979326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777c9cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787759204.979332:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787759204.979509:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf321 00000020:00000080:2.0:1787759204.979515:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777cf4f000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787759204.979589:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787759204.979593:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.979598:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787759204.979602:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d777cf61a48) has no exports 00000020:00000080:2.0:1787759204.979635:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.979640:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787759204.979644:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf328 00000020:00000080:2.0:1787759204.979649:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777cf48000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787759204.980163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf4f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787759204.980199:0:36:0:(genops.c:885:class_export_put()) final put ffff8d777cf4a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787759204.980203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf4a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:2.0:1787759204.980205:0:11970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7758776000 from lustre-MDT0000, refs=3 00000020:01000000:1.0:1787759204.980209:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1787759204.980210:0:11970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7758776000 3 00000020:01000004:2.0:1787759204.980214:0:11970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7758776000 from lustre-MDT0000 00000020:00000080:2.0:1787759204.980239:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.980245:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787759204.980249:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d777cf4f800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787759204.980252:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf4f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787759204.980261:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787759204.980299:0:11970:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787759204.980303:0:11970:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787759204.980306:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787759204.980309:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.980312:0:11970:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787759204.980319:0:11970:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d7748337800 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787759204.980324:0:11970:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d7748200000) has exports, disconnecting them 00000020:00080000:2.0:1787759204.980329:0:11970:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d7748337800), last request at 1787759133 00000020:00000080:2.0:1787759204.980344:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf2c6 00000020:00010000:2.0:1787759204.980350:0:11970:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d7748337800: total 2 00000100:00080000:2.0:1787759204.980361:0:11970:0:(import.c:65:import_set_state_nolock()) ffff8d7748331000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787759204.980396:0:11970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7748337800): rc 0 00000020:00080000:2.0:1787759204.980407:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d7748200000) has no exports 00000020:00010000:3.0:1787759204.980455:0:5824:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d7748337800: total 1 00000020:00000080:1.0:1787759204.980476:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777cf48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787759204.980479:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d7748337800, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1787759204.980514:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d7747be5a00:5829] 1 exiting: rc = 0 00010000:00010000:3.0:1787759204.980518:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166fc00/0x662cc405a6abf61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf615 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980534:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80800/0x662cc405a6abf3c2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf3bb expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980544:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d774166ee00/0x662cc405a6abf669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf662 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980561:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81800/0x662cc405a6abf5d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf5cf expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980574:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782175000/0x662cc405a6abf677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf670 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980593:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a80000/0x662cc405a6abf5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf5c1 expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787759204.980594:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d7760729000:5828] 0 exiting: rc = 1 00010000:00010000:3.0:1787759204.980614:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7782174c00/0x662cc405a6abf5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf5dd expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980631:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d7750a81c00/0x662cc405a6abf5f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x662cc405a6abf5eb expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759204.980647:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d7748337800, canceled 8 locks, left on hash table 0. 00000100:00100000:2.0:1787759204.980653:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d7760729a00:5830] 2 exiting: rc = 0 00000020:00000080:3.0:1787759204.980665:0:5824:0:(genops.c:885:class_export_put()) final put ffff8d7748337800/8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6 00010000:00010000:3.0:1787759204.980685:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759204.980689:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759204.980693:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759204.980712:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980721:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980728:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980736:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980744:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980752:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980759:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980767:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980774:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980781:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980789:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980796:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980804:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980811:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980819:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980828:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980837:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980844:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980852:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980860:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980872:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980882:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980893:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980898:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980909:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980916:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980922:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980927:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980939:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980944:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980950:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980955:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980960:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980966:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980971:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980977:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980982:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980987:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980993:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.980999:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981005:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981010:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981015:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981021:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981027:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981032:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981038:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981043:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981049:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981054:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981060:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981066:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981071:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981077:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981083:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981088:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981093:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981098:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981103:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981108:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981113:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981118:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981124:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759204.981135:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787759204.981271:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7748337800/8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6 for MGS 00000020:00000080:1.0:1787759204.981303:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7748331000 for MGS 20000000:01000000:2.0:1787759204.981677:0:11970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787759204.981681:0:11970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787759204.982084:0:11970:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d77464a0c60 - data ffff8d7745f79798/ffff8d777c71e800 00000020:01000000:2.0:1787759204.982234:0:11970:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d77592b0f60 - data ffff8d774f85e288/ffff8d77609aa800 00000020:00000080:2.0:1787759204.982954:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf2aa 00000020:00000080:2.0:1787759204.982958:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d774820d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787759204.982965:0:11970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7758776000 from MGS, refs=2 00000020:01000004:2.0:1787759204.982966:0:11970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7758776000 2 00000020:01000004:2.0:1787759204.982968:0:11970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7758776000 from MGS 00000020:00000080:2.0:1787759204.982982:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.982986:0:11970:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787759204.982988:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7758775800/MGS 00000020:00000080:2.0:1787759204.982989:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7758775800/MGS for MGS 00000020:01000000:2.0:1787759204.982994:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787759204.983025:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787759204.983027:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.983031:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787759204.983034:0:11970:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d77485cc800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787759204.983037:0:11970:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d7748203490) has exports, disconnecting them 00000020:00080000:2.0:1787759204.983040:0:11970:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d77485cc800), last request at 1787759134 00000020:00000080:2.0:1787759204.983044:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf375 00000020:00080000:2.0:1787759204.983051:0:11970:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d77485cc800): rc 0 00000020:00000080:2.0:1787759204.983053:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d77485cc800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787759204.983340:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d774820d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787759204.983396:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77485cc800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787759204.986342:0:11970:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787759204.986348:0:11970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787759204.986352:0:11970:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787759204.986359:0:11970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787759204.986455:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d774644d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787759204.986632:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.986639:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787759204.986644:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d77485c8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787759204.986655:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d77485c8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787759204.986660:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787759204.986710:0:11970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7758776000 1 00000020:00000080:2.0:1787759204.986715:0:11970:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf29c 00000020:00000080:2.0:1787759204.986720:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7758776800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787759204.986726:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787759204.986729:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.986733:0:11970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787759204.986736:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d7747af3490) has no exports 00000020:00000080:0.0:1787759204.986763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7758776800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787759204.995010:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759204.995024:0:11970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787759204.995030:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7758772000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787759204.995034:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7758772000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787759204.995047:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787759204.995292:0:11970:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d7758770000 00000020:01000000:2.0:1787759204.995318:0:11970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787759204.995322:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787759204.995327:0:11970:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787759204.995331:0:11970:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d774645b490) has no exports 00000100:00100000:3.0:1787759204.995456:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d7744cf3400:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1787759204.995647:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d7744ebd000:5837] 2 exiting: rc = 0 00000100:00100000:0.0:1787759204.995748:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d7744cf3200:5836] 1 exiting: rc = 0 00000100:00100000:2.0:1787759204.995915:0:6792:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d7760072c00:6792] 3 exiting: rc = 0 00000100:00100000:3.0:1787759204.996511:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996531:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996543:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996557:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996571:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996585:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996596:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996609:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996623:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996663:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996676:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996688:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996700:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996713:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996725:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996742:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996752:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996762:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996777:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996787:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996807:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996885:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996898:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996908:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996923:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996932:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996954:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996966:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996977:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.996988:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997005:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997015:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997025:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997035:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997045:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997059:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997069:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997080:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997091:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997102:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997112:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997121:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997131:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997139:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997157:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997168:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997180:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997192:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997203:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997213:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997225:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997234:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997243:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997260:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997270:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997280:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997290:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997300:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997309:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997319:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997330:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997348:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997359:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759204.997392:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787759205.000244:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d7744ebc200:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1787759205.000259:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d7744ebdc00:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787759205.000303:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000318:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000328:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000339:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000349:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000354:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000359:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000383:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000393:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000403:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000412:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000421:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000432:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000442:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000451:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000472:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000480:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000504:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000516:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000526:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000537:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000548:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000555:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000561:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000568:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000581:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000592:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000603:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000615:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000625:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000631:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000640:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000649:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000656:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000661:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000666:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000672:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000678:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000684:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000691:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000696:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000701:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000708:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000713:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000719:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000728:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000739:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000748:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000760:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000769:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000786:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000794:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000801:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000807:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000813:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000818:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000824:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000831:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000837:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000843:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000848:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000854:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000860:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.000865:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787759205.001218:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d77721a2400:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1787759205.001222:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d77721a2800:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1787759205.001283:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001292:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001298:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001304:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001311:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001317:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001324:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001331:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001337:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001354:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001361:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001386:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001396:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001405:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001414:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001422:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001432:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001440:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001448:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001458:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001468:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001506:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001514:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001519:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001525:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001532:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001538:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001545:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001551:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001557:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001563:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001568:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001574:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001593:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001600:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001606:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001612:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001618:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001624:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001629:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001635:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001641:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001646:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001652:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001658:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001677:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001684:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001690:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001697:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001703:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001709:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001715:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001723:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001730:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001737:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001743:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001755:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001776:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001783:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001789:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001795:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001801:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001806:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.001817:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787759205.007332:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d77721a2600:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1787759205.007333:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d7744ebd600:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1787759205.007435:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007446:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007456:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007466:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007471:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007477:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007482:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007499:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007506:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007512:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007517:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007523:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007528:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007533:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007539:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007544:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007550:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007556:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007562:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007567:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007573:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007578:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007584:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007589:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007594:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007599:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007604:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007624:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007629:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007633:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007638:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007643:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007648:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007653:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007659:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007664:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007669:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007675:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007680:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007685:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007690:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007696:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007701:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007706:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007712:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007716:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007722:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007727:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007732:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007737:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007742:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007747:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007752:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007757:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007762:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007768:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007773:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007778:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007783:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007788:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007792:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007796:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007810:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.007815:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787759205.008108:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d77464a9a00:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1787759205.008124:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d77464a8000:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787759205.008187:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008193:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008199:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008204:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008209:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008215:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008220:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008226:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008232:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008237:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008243:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008248:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008253:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008259:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008264:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008269:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008275:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008280:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008285:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008290:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008296:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008301:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008307:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008312:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008318:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008323:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008329:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008333:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008339:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008344:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008350:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008355:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008360:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008576:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008581:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008587:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008592:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008598:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008603:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008609:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008615:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008620:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008625:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008764:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008773:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008780:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008790:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008796:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008802:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008807:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008813:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008818:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008823:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008828:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008833:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008838:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008844:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008849:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008854:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008859:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008864:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008869:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008874:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.008879:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787759205.009229:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d77464a9800:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1787759205.009246:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d77464a9600:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1787759205.009289:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009299:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009307:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009312:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009324:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009330:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009335:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009341:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009347:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009353:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009358:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009387:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009396:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009403:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009410:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009417:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009424:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009430:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009435:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009440:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009445:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009450:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009455:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009462:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009471:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009478:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009487:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009506:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009512:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009518:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009523:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009529:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009534:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009540:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009545:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009550:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009555:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009561:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009566:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009579:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009584:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009589:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009594:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009599:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009605:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009610:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009615:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009620:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009625:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009630:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009635:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009640:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009645:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009650:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009655:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009661:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009666:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009672:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009677:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009682:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009688:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009693:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009698:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.009703:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787759205.010840:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d77464a8e00:5849] 1 exiting: rc = 0 00000100:00100000:1.0:1787759205.010864:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d77464a9000:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787759205.010884:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d77464a9c00:5850] 2 exiting: rc = 0 00000100:00100000:3.0:1787759205.011007:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011014:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011020:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011027:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011032:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011039:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011046:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011053:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011061:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011066:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011082:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011088:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011094:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011101:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011124:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011131:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011136:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011142:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011148:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011154:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011160:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011165:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011172:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011179:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011185:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011191:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011197:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011203:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011208:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011214:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011220:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011226:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011231:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011237:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011243:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011250:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011255:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011261:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011281:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011288:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011294:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011299:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011306:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011312:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011317:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011329:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011336:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011341:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011347:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011352:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011358:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011391:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011403:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011412:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011419:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011427:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011432:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011438:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011444:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011450:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011455:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011460:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011466:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787759205.011472:0:11970:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787759205.015160:0:11970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787759205.015172:0:11970:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787759205.015178:0:11970:0:(genops.c:885:class_export_put()) final put ffff8d7758706800/MDS_uuid 00000020:00000080:3.0:1787759205.015182:0:11970:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7758706800/MDS_uuid for MDS 00000020:01000000:3.0:1787759205.015188:0:11970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787759205.015316:0:11970:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787759205.518558:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787759206.239911:0:7631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787759206.239921:0:7631:0:(genops.c:885:class_export_put()) final put ffff8d7642863800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787759206.239953:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7642863800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787759206.240000:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7642862000 for lustre-OST0001 00010000:00010000:1.0:1787759206.542455:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787759206.622084:0:12173:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787759206.630544:0:12173:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787759206.630590:0:12173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.630624:0:12173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.630632:0:12173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.630640:0:12173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787759206.630669:0:12173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787759206.630683:0:12173:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787759206.630705:0:12173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787759206.630709:0:12173:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787759206.630715:0:12173:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787759206.630742:0:12173:0:(import.c:65:import_set_state_nolock()) ffff8d777c9cd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787759206.630810:0:11282:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787759206.630818:0:11282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.630827:0:11282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a80200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:0.0:1787759206.630831:0:11282:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.630840:0:11282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759206.630845:0:11282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787759206.630849:0:11282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787759206.630851:0:11282:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787759206.630853:0:11282:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787759206.630890:0:11282:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.630910:0:11282:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787759206.630943:0:11282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759206.630950:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a80200/0x662cc405a6abf5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x662cc405a6abf5e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787759206.630961:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601293423872:0@lo:39:umount.0 00010000:00010000:0.0:1787759206.630963:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.630967:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759206.630970:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787759206.630996:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000400:00000100:1.0:1787759206.631017:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293423872 offset 0 length 224: 4 00000100:00100000:2.0:1787759206.631019:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293424000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787759206.631073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787759206.631144:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874601293424000 00000100:00100000:1.0:1787759206.631149:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874601293424000 00000100:00100000:1.0:1787759206.631185:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787759206.631191:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d776e3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1874601293424000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787759206.631197:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787759206 with bad export cookie 7362475019394085574 00000100:00100000:1.0:1787759206.635306:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d776e3861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3306:x1874601293424000:12345-0@lo:103:ldlm_bl.0 Request processed in 4107us (4227us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787759206.635319:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787759206.635330:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787759206.635336:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d7758703800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787759206.635341:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787759206.638595:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.138@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787759206.638599:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787759206.638606:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d776d8c2580 x1874601293424000/t0(0) o103->MGC192.168.204.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787759222 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787759206.638618:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787759206.638635:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787759206.638636:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787759206.638639:0:3306:0:(import.c:65:import_set_state_nolock()) ffff8d7758703800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787759206.638642:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 98 00000100:00080000:2.0:1787759206.638648:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.204.138@tcp: import ffff8d7758703800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1787759206.638672:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d776e384000 x1874601293424128/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787759206.638707:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3306:1874601293424000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787759206.638720:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3302:1874601293424128:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787759206.638760:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874601293424128 offset 0 length 520: 4 00010000:00010000:3.0:1787759207.566521:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759208.590537:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759209.614607:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787759209.807017:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787759209.807028:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787759209.807095:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787759209.807116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293424256:0@lo:400:kworker.0 00000400:00000100:0.0:1787759209.807173:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293424256 offset 0 length 224: 4 00000001:00080000:1.0:1787759209.828005:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1787759209.828096:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787759209.828101:0:6705:0:(genops.c:885:class_export_put()) final put ffff8d7641c82000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787759209.828244:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641c82000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787759209.828287:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d7641c86000 for lustre-OST0000 00010000:00010000:0.0:1787759210.642118:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787759210.831633:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787759210.831671:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787759210.831818:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293424384:0@lo:400:kworker.0 00000400:00000100:3.0:1787759210.831887:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293424384 offset 0 length 224: 4 00010000:00010000:3.0:1787759211.662521:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759212.687205:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759213.711130:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759214.734554:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759215.758553:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787759215.951360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787759215.951389:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787759215.951650:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293424512:0@lo:400:kworker.0 00000400:00000100:0.0:1787759215.951702:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293424512 offset 0 length 224: 4 00010000:00010000:3.0:1787759216.782687:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759216.974514:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787759206/real 1787759206] req@ffff8d776e384000 x1874601293424128/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787759216 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759216.974547:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d776e384000 x1874601293424128/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787759216 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759216.974558:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787759206/real 1787759206] req@ffff8d776e387c00 x1874601293423872/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787759216 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759216.974571:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d776e387c00 x1874601293423872/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787759216 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787759216.974588:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d7758703800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787759216.974612:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787759216.974617:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3302:1874601293424128:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1787759216.974623:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777c9cd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787759216.974644:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e387c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874601293423872:0@lo:39:umount.0 00000100:00080000:2.0:1787759216.974657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787759216.974664:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787759216.974668:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d7758703800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787759216.974673:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.138@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:2.0:1787759216.974679:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787759216.974686:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.138@tcp: import ffff8d7758703800 using connection 192.168.204.138@tcp/0@lo 00000100:00100000:2.0:1787759216.974717:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d776e3843c0 x1874601293424640/t0(0) o250->MGC192.168.204.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787759216.974741:0:12173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787759216.974747:0:12173:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787759216.974753:0:12173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1787759216.974786:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787759216.974816:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601293424768:0@lo:400:kworker.0 00000100:00100000:1.0:1787759216.974818:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776e3843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6:3302:1874601293424640:0@lo:250:kworker.0 00000400:00000100:1.0:1787759216.974877:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874601293424640 offset 0 length 520: 4 00000400:00000100:2.0:1787759216.974884:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293424768 offset 0 length 224: 4 00010000:00010000:3.0:1787759216.975685:0:12173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975698:0:12173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975706:0:12173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975713:0:12173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975735:0:12173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787759216.975743:0:12173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975750:0:12173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975756:0:12173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759216.975763:0:12173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759216.975769:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759216.975781:0:12173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787759216.975784:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787759216.975786:0:12173:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1787759216.975795:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d77609e3a00 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:1.0:1787759216.975799:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759216.975816:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787759216.975820:0:12173:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:00010000:1.0:1787759216.975824:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1787759216.975826:0:12173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1787759216.975829:0:11282:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:3.0:1787759216.975833:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1787759216.975838:0:11282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759216.975840:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:3.0:1787759216.975842:0:12173:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:1.0:1787759216.975845:0:7620:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787759216.975850:0:7620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:3.0:1787759216.975850:0:12173:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d7641a69a48) has no exports 00010000:00010000:0.0:1787759216.975854:0:11282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166e000 already unused, calling callback (ffffffffc1a48c20) 00010000:00010000:1.0:1787759216.975865:0:7620:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7758703800 10000000:00010000:0.0:1787759216.975867:0:11282:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759216.975872:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759216.975894:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d77609e3a00/0x662cc405a6abf5eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759216.975905:0:11282:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787759216.975918:0:11282:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759216.975920:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759216.975923:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787759216.975928:0:11282:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787759216.975928:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787759216.975937:0:11282:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787759216.975940:0:11282:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787759216.975948:0:11282:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7758703800 00010000:00010000:0.0:1787759216.975951:0:11282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759216.975957:0:11282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166e000/0x662cc405a6abf670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf677 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759216.975968:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759216.975970:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759216.975972:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787759216.976088:0:12173:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d7641a69a48) has no exports 00000020:01000000:3.0:1787759216.977774:0:12173:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d776d85f000 - data ffff8d774fac3870/ffff8d777c735800 00000020:01000000:3.0:1787759216.977858:0:12173:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d774811dcc0 - data ffff8d77717491b0/ffff8d76419f5800 00100000:10000000:3.0:1787759216.986161:0:12173:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787759217.007902:0:12173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf3de 00000020:00000080:3.0:1787759217.007919:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d777c0ea800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787759217.007937:0:12173:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d7773d06800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787759217.007942:0:12173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7773d06800 2 00000020:01000004:3.0:1787759217.007945:0:12173:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d7773d06800 from lustre-OST0000 00000020:00000080:1.0:1787759217.007955:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777c0ea800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787759217.007982:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787759217.008001:0:12173:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787759217.008005:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d777c9ce800/lustre-OST0000_UUID 00000020:00000080:3.0:1787759217.008008:0:12173:0:(genops.c:844:class_export_destroy()) destroying export ffff8d777c9ce800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787759217.008014:0:12173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787759217.008067:0:12173:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787759217.008072:0:12173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787759217.008077:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787759217.008082:0:12173:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787759217.008096:0:12173:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d7641c74800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787759217.008102:0:12173:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8d7641a68000) has exports, disconnecting them 00000020:00080000:3.0:1787759217.008107:0:12173:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d7641c74800), last request at 1787759141 00000020:00000080:3.0:1787759217.008111:0:12173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf408 00000020:00080000:3.0:1787759217.008125:0:12173:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d7641c74800): rc 0 00000020:00000080:3.0:1787759217.008148:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d7641c74800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787759217.008178:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641c74800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787759217.008796:0:12173:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787759217.008810:0:12173:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787759217.008814:0:12173:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787759217.008818:0:12173:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787759217.008861:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d777c9cd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787759217.008948:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787759217.008954:0:12173:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787759217.008957:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d7641c73000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787759217.008959:0:12173:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7641c73000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787759217.008965:0:12173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787759217.008986:0:12173:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d7773d06800 1 00000020:00000080:3.0:1787759217.008990:0:12173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x662cc405a6abf398 00000020:00000080:3.0:1787759217.008993:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d7743845000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787759217.009002:0:12173:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787759217.009005:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787759217.009008:0:12173:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787759217.009010:0:12173:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d7747af1a48) has no exports 00000020:00000080:1.0:1787759217.009022:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7743845000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787759217.015107:0:12173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787759217.015120:0:12173:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787759217.015126:0:12173:0:(genops.c:885:class_export_put()) final put ffff8d7773d02800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787759217.015131:0:12173:0:(genops.c:844:class_export_destroy()) destroying export ffff8d7773d02800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787759217.015138:0:12173:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787759217.015332:0:12173:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d7773d00800 00000020:02000400:2.0:1787759217.015414:0:12173:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787759217.807492:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787759218.482394:0:12378:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787759218.486813:0:12378:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787759218.486879:0:12378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759218.486892:0:12378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759218.486901:0:12378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759218.486919:0:12378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759218.487025:0:12378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787759218.487030:0:12378:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787759218.487047:0:12378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1787759218.487054:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787759218.487056:0:12378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d776d8c2580 x1874601293424256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787759218.487061:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759218.487069:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7782175c00 already unused, calling callback (ffffffffc1a48c20) 00000100:00100000:0.0:1787759218.487072:0:12378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d776d84da40 x1874601293424384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:3.0:1787759218.487074:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759218.487091:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759218.487099:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759218.487100:0:12378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d776e387480 x1874601293424512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759231 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759218.487109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874601293424256:0@lo:400:kworker.0 10000000:01000000:3.0:1787759218.487110:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787759218.487120:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787759218.487123:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1787759218.487129:0:12378:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d776e387840 x1874601293424768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787759232 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787759218.487130:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d84da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874601293424384:0@lo:400:kworker.0 00010000:00010000:3.0:1787759218.487135:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7758703800 00010000:00010000:3.0:1787759218.487139:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787759218.487142:0:12378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787759218.487147:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7782175c00/0x662cc405a6abf5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5c8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759218.487158:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759218.487160:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759218.487163:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787759218.487168:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874601293424512:0@lo:400:kworker.0 00000100:00100000:3.0:1787759218.487190:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776e387840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874601293424768:0@lo:400:kworker.0 00000100:00080000:0.0:1787759218.487192:0:12378:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787759218.487212:0:12378:0:(import.c:65:import_set_state_nolock()) ffff8d777c8a6000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787759218.487268:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d776d8c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601293424896:0@lo:39:umount.0 00000400:00000100:1.0:1787759218.487313:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874601293424896 offset 0 length 224: 4 00010000:00010000:1.0:1787759218.830552:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759219.854539:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759220.878517:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759221.902574:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787759222.094541:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787759222.094556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787759222.926501:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787759223.950529:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759224.974533:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759225.998476:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759227.022450:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787759227.214482:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787759227.214493:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8aa45faa-ed3a-4f9b-a4ba-d4249cd6ceb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787759228.046503:0:11282:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787759228.686444:0:3302:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787759218/real 1787759218] req@ffff8d776d8c2940 x1874601293424896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787759228 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787759228.686469:0:3302:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d776d8c2940 x1874601293424896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787759228 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787759228.686482:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8d777c8a6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787759228.686495:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d776d8c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874601293424896:0@lo:39:umount.0 00000100:00080000:0.0:1787759228.686533:0:12378:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787759228.686542:0:12378:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787759228.686546:0:12378:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787759228.687237:0:12378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687259:0:12378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687264:0:12378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687268:0:12378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687282:0:12378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787759228.687287:0:12378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687290:0:12378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687294:0:12378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687297:0:12378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787759228.687309:0:12378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787759228.687312:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:0.0:1787759228.687313:0:12378:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1787759228.687320:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759228.687327:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d774166f200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:3.0:1787759228.687331:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759228.687335:0:5823:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787759228.687338:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787759228.687339:0:12378:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1787759228.687341:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1787759228.687344:0:12378:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787759228.687350:0:12378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787759228.687355:0:12378:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:1.0:1787759228.687355:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d7750a81200 already unused, calling callback (ffffffffc1a48c20) 10000000:00010000:1.0:1787759228.687361:0:5823:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787759228.687362:0:12378:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d7641a6ced8) has no exports 00010000:00010000:1.0:1787759228.687384:0:5823:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787759228.687390:0:5823:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787759228.687391:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787759228.687402:0:5823:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787759228.687408:0:5823:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787759228.687412:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787759228.687413:0:5823:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787759228.687420:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787759228.687423:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787759228.687432:0:5823:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7758703800 00010000:00010000:3.0:1787759228.687434:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d7758703800 00010000:00010000:1.0:1787759228.687436:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759228.687445:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787759228.687449:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d7750a81200/0x662cc405a6abf662 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf669 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759228.687453:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.138@tcp lock: ffff8d774166f200/0x662cc405a6abf5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x662cc405a6abf5d6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787759228.687469:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759228.687472:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759228.687473:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759228.687477:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787759228.687478:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787759228.687481:0:5823:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787759228.687554:0:12378:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d7641a6ced8) has no exports 00000020:01000000:0.0:1787759228.688894:0:12378:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d77464a0060 - data ffff8d7745f79af8/ffff8d777c71c000 00000020:01000000:0.0:1787759228.689038:0:12378:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff8d777c88aa20 - data ffff8d774f9fc000/ffff8d7642a71c00 00100000:10000000:0.0:1787759228.697739:0:12378:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap Debug log: 9119 lines, 9119 kept, 0 dropped, 0 bad.